Code

[WIP] Worker-driven batch processing#399

Code

Open

Evildoor wants to merge 16 commits intomasterPanDAWMS/dkb:masterfrom batch-worker-drivenPanDAWMS/dkb:batch-worker-drivenCopy head branch name to clipboard

+280-11

Commits

Commits on Aug 26, 2020

• Add BNC marker handling.

  Evildoor

  committed
  59effae

• Add an option to set batch size for a stage.

  Evildoor

  committed
  43af39f

• Add input markers handling.

  Show description for dc2b5c5
  Evildoor

  committed
  dc2b5c5

• Set BNC to be non-empty by default.

  Show description for 129e5a0
  Evildoor

  committed
  129e5a0

• Stop processing on receiving unexpected marker.

  Evildoor

  committed
  ee4f3eb

• Add checks for batch size type and value.

  Evildoor

  committed
  1e66a77

• Move marker handling to input.

  Show description for e9a959e
  Evildoor

  committed
  e9a959e

• Add batch processing.

  Evildoor

  committed
  50c79c7

• Add a simple stage for batch proc development.

  Evildoor

  committed
  f9bfcdd

• Add message type check.

  Evildoor

  committed
  2f38b2b

• Test stage: make process() support batches.

  Evildoor

  committed
  7ba3aa5

• Set BNC to empty string.

  Evildoor

  committed
  4f424e5

• Add a script comparing normal and batch modes.

  Evildoor

  committed
  ffaf064

• Don't prepare for input markers in normal mode.

  Evildoor

  committed
  b252d74

• Set EOB to be non-empty by default.

  Show description for 130d600
  Evildoor

  committed
  130d600

Commits on Sep 1, 2020

• Set EOP to "" to remove need for eop_filter.

  Evildoor

  committed
  7ba11b6