Package testing

[strtgbb]

Rewrite clickhouse-regression to use released docker images

• Update Cluster to use released docker images
  • For clickhouse
  • For keeper
• Fix fails related to missing cli tools
• Fix fails related to alpine base
• Add the ability to install a release package onto a base os image
  • ubuntu/deb
  • alpine/tgz
  • centos/rpm
  • clickhouse-regression-multiarch
• Create a class to handle binary unpacking and simplify Cluster
• Test base-os option in all suites
• Support testing local installs
• Enable base-os column in uploader
• Review reuse-env behaviour
• Update readme

[strtgbb]

Blocking issues

Alpine

https://github.com/Altinity/clickhouse-regression/actions/runs/10791994233/

Parquet suite fails, unknown cause.

Shell utilities are missing or different (list so far):

• ps - more verbose output, added grep.
• stat - restricted syntax, calls updated.
• useradd - unavailable, installed the shadow package. Can't use adduser, the syntax is incompatible.
• head | cut - used for checking file headers has different output, fixed by applying head again.
• curl - does not support kerberos negotiation by default, have not figured out how to enable it.
• openssl - something's off with cert verification, needs investigation.

OpenSSL error:

C=CA, ST=ON, L=Ottawa, O=Altinity, OU=QA, CN=root, [email protected]
    error 92 at 1 depth lookup: CA cert does not include key usage extension
    error /etc/clickhouse-server/server.crt: verification failed

RHEL-family

Testflows Shell() doesn't instantiate correctly on RHEL-family distros, same result on Fedora and UBI.

[clickhouse1] clickhouse1:/^G[root@clickhouse1 /]# export PS1="bash # "
[clickhouse1] clickhouse1:/^Gbash # echo 1
[clickhouse1] 1

[strtgbb]

Latest runs: https://github.com/Altinity/clickhouse-regression/actions?query=branch%3Apackage-testing
Aggregate functions suite fails in package mode, snapshot not found error.
RHEL mode also has a lot of fails.

If a package is specified, but base-os is not, should base-os be chosen automatically?