Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: isolate test suite #99

Merged
merged 26 commits into from
Mar 1, 2024
Merged

feat: isolate test suite #99

merged 26 commits into from
Mar 1, 2024

Conversation

cpaniaguam
Copy link
Member

  • Add test data files for steps 2-5. This includes new data sets that will be used for testing the functionality of steps 2 through 5
  • Handle tar.gz files via Git Large File Storage (LFS)
  • Add tests for step 1.

Once PRs #90, #92 , #94 (cli's for steps 2-4) are merged the commented code in test_steps.py can be uncommented and then update the CI workflow to run all tests via the test suite.

#96

This commit updates the test-B01_SL_load_single_file.yml workflow file. It changes the name of the workflow to "Test steps" and updates the runs-on value to "ubuntu-latest". Additionally, it adds a step to enable Git LFS and installs pytest and its dependencies. Finally, it updates the run command for the first step and adds a new step to run tests using pytest.
@cpaniaguam cpaniaguam added the enhancement New feature or request label Feb 1, 2024
@cpaniaguam cpaniaguam self-assigned this Feb 1, 2024
Copy link
Collaborator

@kmilo9999 kmilo9999 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How you feel about renaming the CI workflow file? test.yml is too general.

@cpaniaguam
Copy link
Member Author

How you feel about renaming the CI workflow file? test.yml is too general.

I am open. What would be a better name? Naming things is sometimes tricky! @kmilo9999

@kmilo9999
Copy link
Collaborator

Reference

what about test_icesat2_pipeline.yml. The value of the name tag can be changed to the same name

@cpaniaguam
Copy link
Member Author

Reference

what about test_icesat2_pipeline.yml. The value of the name tag can be changed to the same name

I like that name! Do we anticipate having other pipelines other than the one for the icesat2 package? @kmilo9999

@kmilo9999
Copy link
Collaborator

Reference

what about test_icesat2_pipeline.yml. The value of the name tag can be changed to the same name

I like that name! Do we anticipate having other pipelines other than the one for the icesat2 package? @kmilo9999

I dont know. We can rename the file again if new pipelines appear and there's a way to distinguish between them.

@cpaniaguam
Copy link
Member Author

I dont know. We can rename the file again if new pipelines appear and there's a way to distinguish between them.

Do you believe in YAGNI? @kmilo9999

@kmilo9999
Copy link
Collaborator

I dont know. We can rename the file again if new pipelines appear and there's a way to distinguish between them.

Do you believe in YAGNI? @kmilo9999

I do believe in it. I just want to have a clear idea that the file runs the pipeline's tests.

@cpaniaguam cpaniaguam changed the base branch from 93-cli-step-4-a02c_iowaga_thredds_priorpy to 95-cli-step-5-b04_anglepy February 9, 2024 15:30
@kmilo9999
Copy link
Collaborator

Review and merge this PR after CLI full integration.

Copy link
Member

@hollandjg hollandjg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Just marking this as needing changes – uncommenting the commented-out tests – so it disappears from the list of needed reviews. Thanks!)

Base automatically changed from 95-cli-step-5-b04_anglepy to 93-cli-step-4-a02c_iowaga_thredds_priorpy February 16, 2024 23:51
Base automatically changed from 93-cli-step-4-a02c_iowaga_thredds_priorpy to 91-cli-step-3-b03_plot_spectra_ovpy February 17, 2024 05:37
Base automatically changed from 91-cli-step-3-b03_plot_spectra_ovpy to 89-cli-step-2-b02_make_spectra_gft February 17, 2024 06:10
Copy link
Member

@hollandjg hollandjg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi Carlos, thanks for this! It looks like a well thought through method of isolating the testing of each of the steps.
I've got some suggestions for simplifications and changes, and some requests for more info!

.github/workflows/test_icesat2_tracks_pipeline.yml Outdated Show resolved Hide resolved
tests/test_steps.py Show resolved Hide resolved
tests/test_steps.py Show resolved Hide resolved
.gitattributes Outdated Show resolved Hide resolved
tests/test_steps.py Outdated Show resolved Hide resolved
tests/test_steps.py Show resolved Hide resolved
tests/test_steps.py Show resolved Hide resolved
tests/test_steps.py Show resolved Hide resolved
tests/test_steps.py Show resolved Hide resolved
.github/workflows/test_icesat2_tracks_pipeline.yml Outdated Show resolved Hide resolved
Copy link
Member

@tdivoll tdivoll left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The code looks good and it seems like many suggestions have already been incorporated. I just found some small text cleanups.

.github/workflows/test_icesat2_tracks_pipeline.yml Outdated Show resolved Hide resolved
tests/test_steps.py Outdated Show resolved Hide resolved
tests/test_steps.py Show resolved Hide resolved
tests/test_steps.py Outdated Show resolved Hide resolved
tests/test_steps.py Show resolved Hide resolved
tests/test_steps.py Outdated Show resolved Hide resolved
@cpaniaguam
Copy link
Member Author

The code looks good and it seems like many suggestions have already been incorporated. I just found some small text cleanups.

Thanks @tdivoll!

@cpaniaguam cpaniaguam requested a review from tdivoll February 29, 2024 16:03
tdivoll
tdivoll previously approved these changes Feb 29, 2024
Copy link
Member

@tdivoll tdivoll left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a couple formatting things that seem like they didn't come through in the last commit. I unresolved a couple of the comments to make it easier to find them.

Copy link
Member

@tdivoll tdivoll left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!

Copy link
Collaborator

@kmilo9999 kmilo9999 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good to me

Copy link
Member

@hollandjg hollandjg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems to work!

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changes to this file are no longer related to the main change, so we could split these out. But I think they are fine.

@cpaniaguam cpaniaguam merged commit a737360 into main Mar 1, 2024
2 checks passed
@cpaniaguam cpaniaguam deleted the 96-isolate-test-suite branch March 1, 2024 16:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Isolate test suite
4 participants