HPCC-29657 Produce aggregate stats (e.g. spill, cost) whilst a job is running #6258

Job	Run time
Check Skip	10s
Build Docker (ubuntu-23.04, pull_request)	42m 29s
Build Docker (ubuntu-22.04, k8s, true, schedule)	15s
Build Bare Metal (ubuntu-20.04, mono, sudo, -DCMAKE_BUILD_TYPE=RelWithDebInfo -DINCLUDE_PLUGINS=O...	2s
Build Docker (ubuntu-22.04, schedule)	1m 20s
Build Bare Metal (ubuntu-22.04, mono, sudo, -DCMAKE_BUILD_TYPE=RelWithDebInfo -DINCLUDE_PLUGINS=O...	35m 36s
Build Docker (ubuntu-20.04, schedule)	1m 10s
Build Bare Metal (windows-2019, -T host=x64 -A x64 -DUSE_OPTIONAL=OFF -DCLIENTTOOLS_ONLY=ON -DUSE...	3s
Build Docker (centos-8, schedule)	10s
Build Bare Metal (windows-2022, -T host=x64 -A x64 -DUSE_OPTIONAL=OFF -DCLIENTTOOLS_ONLY=ON -DUSE...	16m 9s
Build Docker (centos-7, pull_request)	1h 0m 25s
Build Bare Metal (macos-11, mono, sudo, -DCMAKE_BUILD_TYPE=Release -DUSE_OPTIONAL=OFF -DCLIENTTOO...	5s
Build Docker (amazonlinux, schedule)	14s
Build Bare Metal (macos-12, mono, sudo, -DCMAKE_BUILD_TYPE=Release -DUSE_OPTIONAL=OFF -DCLIENTTOO...	19m 31s
Build Docker (centos-7, LN, true, schedule)	14s
	2h 57m 53s

Provide feedback