process-compose gets stuck on quit if clickhouse init db fails

[conscious-puppet]

process-compose gets stuck on quit if the the clickhouse init db service fails. we need to manually kill the clickhouse process.

the issue can be reproduced by using a malformed initial db dump with the clickhouse service.

[shivaraj-bh]

Here’s the culprit:

services-flake/nix/services/clickhouse/default.nix

Lines 120 to 125 in deaa2b8

	clickhouse-server --config-file=${clickhouseConfig} &
	sleep 5s
	echo "Clickhouse server started."
	${setupInitialDatabases}
	echo "Clickhouse db setting is done."
	kill %1

During init the server starts and because the schema files have errors, and exits with non-zero exit-code, the script stops before killing the server.

[shivaraj-bh]

The easiest fix is to run the shell script without breaking on errors in any intermediate command.

But, I would like to see if we can just avoid starting the clickhouse-server in the init script, by just waiting for the server process to start and then init the schemas.

pinging @roman-bodavskiy to see if you have any opinion on this as you worked on this in #91