Skip to content

Commit

Permalink
Add extra docs info on target duratiom
Browse files Browse the repository at this point in the history
  • Loading branch information
rossmacdonald-ow committed Oct 15, 2024
1 parent 2a04652 commit cc9af1d
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion doc/source/operator_resources.rst
Original file line number Diff line number Diff line change
Expand Up @@ -500,7 +500,10 @@ using dask's adaptive mode.

By creating the resource the operator controller will periodically poll the scheduler and request the desired number of workers.
The scheduler calculates this number by profiling the tasks it is processing and then extrapolating how many workers it would need
to complete the current graph within 5 seconds.
to complete the current graph within the target duration.
By default the target duration is 5 seconds but
`it can be adjusted via the "distributed.adaptive.target-duration" in the scheduler config <https://docs.dask.org/en/latest/configuration.html>`_.


.. mermaid::

Expand Down

0 comments on commit cc9af1d

Please sign in to comment.