From d4d41124ee065e556f3398daf4c9b74c60c8ab6f Mon Sep 17 00:00:00 2001 From: rossmacdonald-ow <140158251+rossmacdonald-ow@users.noreply.github.com> Date: Tue, 15 Oct 2024 10:03:44 +0100 Subject: [PATCH] Add extra docs info on target duratiom (#911) --- docs/source/operator_resources.rst | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/docs/source/operator_resources.rst b/docs/source/operator_resources.rst index d6598dcff..b4b3ffb70 100644 --- a/docs/source/operator_resources.rst +++ b/docs/source/operator_resources.rst @@ -500,7 +500,10 @@ using dask's adaptive mode. By creating the resource the operator controller will periodically poll the scheduler and request the desired number of workers. The scheduler calculates this number by profiling the tasks it is processing and then extrapolating how many workers it would need -to complete the current graph within 5 seconds. +to complete the current graph within the target duration. +By default the target duration is 5 seconds but +`it can be adjusted via the "distributed.adaptive.target-duration" in the scheduler config `_. + .. mermaid::