Upgrade receiver and workers

[benoit74]

Rationale

Maintenance

Changes

• Upgrade receiver:
  • Upgrade to Python 3.12 + Debian slim bookworm
  • Upgrade to Jailkit 2.23
• Upgrade task worker:
  • Upgrade to Python 3.12 + Debian slim bookworm
  • Upgrade and pin Python dependencies
• Upgrade worker manager:
  • Upgrade to Python 3.12 + Debian slim bookworm
  • Upgrade and pin Python dependencies
• Fix small bug in receiver get_zimfarm_key.py usage
• Adapt development docker-compose:
  • remove ssh-host: this should have been the receiver from the beginning
  • add receiver
    • including helper script to create all required warehouse paths
  • add commented worker manager and task worker
  • add instructions in dev/README.md
  • add contrib script to create a worker / start first requested task
  • fix backend configuration to upload all artifacts to receiver
  • fix uploader tests to use receiver instead of ssh-host
• trigger a rebuild of dnscache
• modify task worker to use latest images of dnscache, uploader
• remove zmq for worker dependencies + corresponding files

Open point: is it normal that we need to create all warehouse paths in the receiver manually ? This is not part of the procedure to create a new warehouse path, so I'm a bit surprised

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 87.84%. Comparing base (ecee845) to head (ded4301).

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #929   +/-   ##
=======================================
  Coverage   87.84%   87.84%           
=======================================
  Files          93       93           
  Lines        5297     5297           
=======================================
  Hits         4653     4653           
  Misses        644      644           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[rgaudin]

Good

[rgaudin]

Thank you