Skip to content

Commit

Permalink
PaRSEC backend: offload reductions to dedicated task
Browse files Browse the repository at this point in the history
When we encounter a streaming terminal we schedule a dedicated
reducer task. Subsequent inputs are put into a LIFO. Once the
reducer task runs it will process all available inputs for that
terminal but will not block waiting for all inputs. In the
worst case, we create N tasks (one for each input), likely less.

Signed-off-by: Joseph Schuchart <[email protected]>
  • Loading branch information
devreal committed May 26, 2023
1 parent a112f4b commit 7bd063b
Showing 1 changed file with 318 additions and 40 deletions.
Loading

0 comments on commit 7bd063b

Please sign in to comment.