Skip to content

Commit

Permalink
Add extra docs info on target duratiom (#911)
Browse files Browse the repository at this point in the history
  • Loading branch information
rossmacdonald-ow authored Oct 15, 2024
1 parent ab1be69 commit d4d4112
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion docs/source/operator_resources.rst
Original file line number Diff line number Diff line change
Expand Up @@ -500,7 +500,10 @@ using dask's adaptive mode.

By creating the resource the operator controller will periodically poll the scheduler and request the desired number of workers.
The scheduler calculates this number by profiling the tasks it is processing and then extrapolating how many workers it would need
to complete the current graph within 5 seconds.
to complete the current graph within the target duration.
By default the target duration is 5 seconds but
`it can be adjusted via the "distributed.adaptive.target-duration" in the scheduler config <https://docs.dask.org/en/latest/configuration.html>`_.


.. mermaid::

Expand Down

0 comments on commit d4d4112

Please sign in to comment.