Better retries for IO, logging

[carlosgjs]

• Fix/refactor retry logic for S3 IO
• Log which station pairs failed in CC (similar to stacking)
• Avoid repeatedly checking the S3 bucket for existing pairs when it's empty

[codecov]

Codecov Report

Attention: 9 lines in your changes are missing coverage. Please review.

Comparison is base (1fa1daf) 70.56% compared to head (46b8db2) 70.56%.

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #243   +/-   ##
=======================================
  Coverage   70.56%   70.56%           
=======================================
  Files          36       36           
  Lines        4165     4179   +14     
  Branches      576      581    +5     
=======================================
+ Hits         2939     2949   +10     
- Misses       1092     1094    +2     
- Partials      134      136    +2     

Files	Coverage Δ
src/noisepy/seis/hierarchicalstores.py	96.64% <100.00%> (-0.20%)	⬇️
src/noisepy/seis/main.py	82.12% <100.00%> (ø)
tests/test_hierarchicalstores.py	100.00% <100.00%> (ø)
src/noisepy/seis/utils.py	90.47% <93.33%> (+0.33%)	⬆️
src/noisepy/seis/correlate.py	76.86% <46.66%> (-1.04%)	⬇️

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.