Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reorder correlated error setup checks #736

Merged
merged 1 commit into from
Apr 22, 2024

Conversation

RussTreadon-NOAA
Copy link
Contributor

@RussTreadon-NOAA RussTreadon-NOAA commented Apr 19, 2024

Description
g-w issue #2507 flagged a gsi.x failure related to correlated error in a historical case. Rearranging the correlated error setup checks allows gsi.x to successfully run the historical case.

Fixes #735

Type of change

  • Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?
Two tests have been conducted

  1. Run failed 2021032418 case using updated gsi.x. GSI run to completion
  2. Run ctests on Hera. All tests pass.
Test project /scratch1/NCEPDEV/da/Russ.Treadon/git/gsi/develop_test/build
    Start 1: global_4denvar
    Start 2: rtma
    Start 3: rrfs_3denvar_glbens
    Start 4: netcdf_fv3_regional
    Start 5: hafs_4denvar_glbens
    Start 6: hafs_3denvar_hybens
    Start 7: global_enkf
1/7 Test #4: netcdf_fv3_regional ..............   Passed  1209.16 sec
2/7 Test #3: rrfs_3denvar_glbens ..............Passed  1214.33 sec
3/7 Test #7: global_enkf ......................   Passed  1416.07 sec
4/7 Test #2: rtma .............................   Passed  1811.61 sec
5/7 Test #5: hafs_4denvar_glbens ..............   Passed  1887.12 sec
6/7 Test #6: hafs_3denvar_hybens ..............   Passed  1887.89 sec
7/7 Test #1: global_4denvar ...................   Passed  2468.95 sec

100% tests passed, 0 tests failed out of 7

Total Test time (real) = 2468.98 sec

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code

@RussTreadon-NOAA RussTreadon-NOAA self-assigned this Apr 19, 2024
@RussTreadon-NOAA
Copy link
Contributor Author

@CatherineThomas-NOAA and @ADCollard - this PR contains the changes to src/gsi/correlated_obsmod.F90 described in g-w issue #2507.

I don't know the inner workings of correlated error. While the modified src/gsi/correlated_obsmod.F90 allows the failed case to pass, your review of the change would be greatly appreciated.

Copy link
Contributor

@ADCollard ADCollard left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@RussTreadon-NOAA Thank you so much for fixing this. There is no reason for the code to exit in this case.

Copy link
Collaborator

@CatherineThomas-NOAA CatherineThomas-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for working out a fix to this, @RussTreadon-NOAA!

@RussTreadon-NOAA RussTreadon-NOAA changed the title reorder correlated error setup checks (#735) reorder correlated error setup checks Apr 20, 2024
@RussTreadon-NOAA
Copy link
Contributor Author

Orion ctests

Test project /work2/noaa/da/rtreadon/git/gsi/pr736/build
    Start 1: global_4denvar
    Start 2: rtma
    Start 3: rrfs_3denvar_glbens
    Start 4: netcdf_fv3_regional
    Start 5: hafs_4denvar_glbens
    Start 6: hafs_3denvar_hybens
    Start 7: global_enkf
1/7 Test #4: netcdf_fv3_regional ..............   Passed  544.36 sec
2/7 Test #3: rrfs_3denvar_glbens ..............   Passed  671.46 sec
3/7 Test #7: global_enkf ......................   Passed  798.60 sec
4/7 Test #2: rtma .............................   Passed  968.64 sec
5/7 Test #6: hafs_3denvar_hybens ..............   Passed  1167.65 sec
6/7 Test #5: hafs_4denvar_glbens ..............   Passed  1341.63 sec
7/7 Test #1: global_4denvar ...................   Passed  1745.74 sec

100% tests passed, 0 tests failed out of 7

Total Test time (real) = 1745.75 sec

Hercules ctests

Test project /work/noaa/da/rtreadon/git/gsi/pr736/build
    Start 1: global_4denvar
    Start 2: rtma
    Start 3: rrfs_3denvar_glbens
    Start 4: netcdf_fv3_regional
    Start 5: hafs_4denvar_glbens
    Start 6: hafs_3denvar_hybens
    Start 7: global_enkf
1/7 Test #4: netcdf_fv3_regional ..............   Passed  484.66 sec
2/7 Test #3: rrfs_3denvar_glbens ..............   Passed  551.02 sec
3/7 Test #7: global_enkf ......................   Passed  726.58 sec
4/7 Test #2: rtma .............................   Passed  965.16 sec
5/7 Test #6: hafs_3denvar_hybens ..............   Passed  1092.17 sec
6/7 Test #5: hafs_4denvar_glbens ..............   Passed  1226.01 sec
7/7 Test #1: global_4denvar ...................   Passed  1741.68 sec

100% tests passed, 0 tests failed out of 7

Total Test time (real) = 1741.89 sec

As expected, reordering the correlated error setup checks does not alter analysis results, wall time, or memory usage.

@RussTreadon-NOAA
Copy link
Contributor Author

WCOSS2 (Dogwood) ctests

Test project /lfs/h2/emc/da/noscrub/russ.treadon/git/gsi/pr736/build
    Start 1: global_4denvar
    Start 2: rtma
    Start 3: rrfs_3denvar_glbens
    Start 4: netcdf_fv3_regional
    Start 5: hafs_4denvar_glbens
    Start 6: hafs_3denvar_hybens
    Start 7: global_enkf
1/7 Test #4: netcdf_fv3_regional ..............   Passed  483.67 sec
2/7 Test #3: rrfs_3denvar_glbens ..............   Passed  486.31 sec
3/7 Test #7: global_enkf ......................   Passed  851.93 sec
4/7 Test #2: rtma .............................   Passed  969.51 sec
5/7 Test #6: hafs_3denvar_hybens ..............   Passed  1153.08 sec
6/7 Test #5: hafs_4denvar_glbens ..............   Passed  1213.29 sec
7/7 Test #1: global_4denvar ...................   Passed  1682.47 sec

100% tests passed, 0 tests failed out of 7

Total Test time (real) = 1682.48 sec

@RussTreadon-NOAA RussTreadon-NOAA merged commit 457510c into NOAA-EMC:develop Apr 22, 2024
4 checks passed
@RussTreadon-NOAA RussTreadon-NOAA deleted the feature/rcov branch April 22, 2024 13:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

gsi.x failure with correlated error
3 participants