2022-01-10 PyAerocom meeting

[avaldebe]

Follow up from last meeting

Jan 3rd #568

Plans for 2022

• CAMS2-82 Earlinet and CAMS extinction profile comparison #539
• CAMS2_83 CAMS2_83 plots / long-term plans #525
  first prototype service on AeroVal running by April.
  details at the kick-off meeting, not before January 14th.
• CAMS84 Maps of variables #522
• CAMS84 Documentation of temporal colocation strategy #521
• CAMS84 Mapped Anomalies against reanalysis #520
• CAMS84 New variable PM10/PM25 ratio #519
• CAMS84 3hourly as a basis for Aeronet colocation #518
• C3S_Aerosol add GCOS quality criterion to the statistics #394

Failing CI tests

e.g.

[...]
.tox/py/lib/python3.9/site-packages/xarray/core/pycompat.py:22: in __init__
    duck_array_version = LooseVersion(duck_array_module.__version__)
.tox/py/lib/python3.9/site-packages/setuptools/_distutils/version.py:53: in __init__
    warnings.warn(
E   DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
ERROR: InvocationError for command /home/runner/work/pyaerocom/pyaerocom/.tox/py/bin/pytest -ra -q --cov (exited with code 4)

Which was fixed on test against python 3.10 on PR #542 (merged today) (see xarray PR pydata/xarray#6096)

How should we handle DeprecationWarnings?

• Ignore them on CI
• Fail on CI, so they are resolved ASAP
• Periodically check for new warnings, e.g. on a cron CI job

For now, we'll let CI fail when new DeprecationWarnings are found and make a notice at the next meeting.
In c.a. 3 months, we'll view the frequency of such problems and decide on a strategy.

New PRs

• CAMS2-83 surface observations #546 (draft)
• AeronetSDAv3 reading: provide od550gtaer data as od550dust data #545 (draft)

Standing PRs

• clean up entry points #540 (introducing last week, ready to merge)
• test against python 3.10 on CI #542 (merged today) (could not create conda 3.10 env)

New Issues

• include sentinel5p L2 data reading in the pyaerocom distribution #543
• AeronetSDAV3 data reading: provide od550gt1aer data as od550dust data #544

Python Books

• Robust Python
• Python Testing with pytest, 2nd edition (coming February 2022)
• Fluent Python, 2nd edition (coming later this year)

For next meeting

• Daniel will take a look at PR CAMS2-83 surface observations #546
• Álvaro will update and merge PR clean up entry points #540
• Álvaro will test adding conda channel to conda env
  • conda still broken for Python 3.10 on CI
  • update conda CI jobs #548 fixes it and reduces env creation time
• Python packaging mini workshop with Álvaro, Krister, Daniel and Charlie