Race condition in s3_staging between ingest and preview??

[phirstgemini]

Wondering if ingest and preview may be colliding in s3_staging?

/data/logs/service_ingest_queue.py-1.log.1:2024-10-05 15:44:47,368 967738:service_ingest_queue:131 INFO: Ingesting N20241005S0292.fits.bz2 - 5770586 (1 on queue)
/data/logs/service_ingest_queue.py-1.log.1:2024-10-05 15:44:47,410 967738:ingester:165 INFO: Adding new file table entry for N20241005S0292.fits.bz2
/data/logs/service_ingest_queue.py-1.log.1:2024-10-05 15:44:48,732 967738:ingester:568 INFO: Adding N20241005S0292.fits.bz2 to preview queue
/data/logs/service_ingest_queue.py-1.log.1:2024-10-05 15:45:02,198 967738:service_ingest_queue:131 INFO: Ingesting N20241005S0292.fits.bz2 - 5770589 (1 on queue)
/data/logs/service_ingest_queue.py-1.log.1:2024-10-05 15:45:02,250 967738:aws_s3:233 WARNING: File already exists at S3 download location: /data/s3_staging/N20241005S029.fits.bz2. Will delete it first.
/data/logs/service_ingest_queue.py-1.log.1:2024-10-05 15:45:03,697 967738:ingester:568 INFO: Adding N20241005S0292.fits.bz2 to preview queue
/data/logs/service_ingest_queue.py-1.log.1:FileNotFoundError: [Errno 2] No such file or directory: '/data/s3_staging/N20241005S0292.fits.bz2'

/data/logs/service_preview_queue.py-1.log:2024-10-05 15:44:50,911 569737:service_preview_queue:104 INFO: Previewing N20241005S0292.fits.bz2 - 5721647 (5278 on queue)
/data/logs/service_preview_queue.py-1.log:2024-10-05 15:44:51,003 569737:previewer:187 INFO: Rendering preview for N20241005S0292.fits.bz2
/data/logs/service_preview_queue.py-1.log:2024-10-05 15:45:02,613 569737:previewer:159 INFO: Uploading preview N20241005S0292.fits.bz2_preview.jpg to S3
/data/logs/service_preview_queue.py-1.log:2024-10-05 15:45:07,989 569737:service_preview_queue:104 INFO: Previewing N20241005S0292.fits.bz2 - 5721650 (5278 on queue)