Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update testing for release #475

Merged
merged 28 commits into from
May 23, 2024

Conversation

dustinswales
Copy link
Collaborator

@dustinswales dustinswales commented May 21, 2024

This PR contains changes/updates to the SCM RT CI for the CCPP V7 release. Includes the following:

  • SCM RT suite list updated to supported V7 SDFs/NML/tracers configurations.
  • Working CCPP v6 and v5 SDF/nml/tracer configurations are still run as part of the SCM RT suite, but listed as unsupported options (i.e. If/when they break, we don't fix em).
  • Plotting script for SCM RT vs. Baseline comparison step. Plots of all SCM outputs for all supported cases and suites are created and uploaded to GitHub as an "artifact"

This PR contains changes from #467 and #474.

@@ -150,6 +150,7 @@ jobs:
cd ${SCM_ROOT}
./contrib/get_all_static_data.sh
./contrib/get_thompson_tables.sh
./contrib/get_aerosol_climo.sh
Copy link
Collaborator

@grantfirl grantfirl May 22, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is going to (potentially) slow down CI a lot since the files are big. Any way to stash this data for future use?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was worried that this was going to bring this whole thing crashing down, but to my surprise it is faster to download this data on the GitHub servers than on Hera. It only took ~2min., but that's more than the ~15sec before.
There may be slick ways to stash this, I just don't know any.

test/cmp_rt2bl.py Outdated Show resolved Hide resolved
test/cmp_rt2bl.py Outdated Show resolved Hide resolved
Copy link
Collaborator

@grantfirl grantfirl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wonderful as-is, but there are a few questions to ponder.

@dustinswales
Copy link
Collaborator Author

@grantfirl I addressed your concerns. Now the script only creates plots when there are differences, and the comparison/plotting scripts are usable outside of the RT/CI context (I used them offline for faster debugging of the CI plots)
All good to merege!

@grantfirl grantfirl merged commit 8183aa6 into NCAR:main May 23, 2024
18 of 22 checks passed
@dustinswales dustinswales deleted the feature/testing_for_release branch July 1, 2024 20:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants