HPCC-29657 Produce aggregate stats (e.g. spill, cost) whilst a job is running #6663

Job	Run time
Check Skip	25s
Build Docker (ubuntu-23.10, pull_request)	5m 41s
Build Docker (ubuntu-22.04, k8s, true, schedule)	37s
Build Bare Metal (ubuntu-20.04, mono, sudo, -DCMAKE_BUILD_TYPE=RelWithDebInfo -DINCLUDE_PLUGINS=O...	3s
Build Docker (ubuntu-22.04, schedule)	1m 3s
Build Bare Metal (ubuntu-22.04, mono, sudo, -DCMAKE_BUILD_TYPE=RelWithDebInfo -DINCLUDE_PLUGINS=O...	36m 54s
Build Docker (ubuntu-20.04, schedule)	16s
Build Bare Metal (windows-2019, -T host=x64 -A x64 -DUSE_OPTIONAL=OFF -DCLIENTTOOLS_ONLY=ON -DUSE...	4s
Build Docker (centos-8, schedule)	37s
Build Bare Metal (windows-2022, -T host=x64 -A x64 -DUSE_OPTIONAL=OFF -DCLIENTTOOLS_ONLY=ON -DUSE...	26m 26s
Build Docker (centos-7, pull_request, -DVCPKG_TARGET_TRIPLET=x64-centos-7-dynamic)	56m 27s
Build Bare Metal (macos-11, mono, sudo, -DCMAKE_BUILD_TYPE=Release -DUSE_OPTIONAL=OFF -DCLIENTTOO...	21s
Build Docker (amazonlinux, schedule, -DVCPKG_TARGET_TRIPLET=x64-amazonlinux-dynamic)	18s
Build Bare Metal (macos-12, mono, sudo, -DCMAKE_BUILD_TYPE=Release -DUSE_OPTIONAL=OFF -DCLIENTTOO...	10m 8s
Build Docker (centos-7, LN, -DVCPKG_TARGET_TRIPLET=x64-centos-7-dynamic, true, schedule)	15s
	2h 19m 35s

Provide feedback