Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend Webdataset creation to Live SDOML #24

Open
dead-water opened this issue Aug 6, 2024 · 1 comment · May be fixed by #26
Open

Extend Webdataset creation to Live SDOML #24

dead-water opened this issue Aug 6, 2024 · 1 comment · May be fixed by #26
Assignees
Labels

Comments

@dead-water
Copy link
Member

Take the work completed for the 4K SDOML calibration and apply to the real-time Synoptic Feed

@dead-water dead-water added this to the Marshall Meeting milestone Aug 6, 2024
@dead-water dead-water self-assigned this Aug 6, 2024
@dead-water dead-water linked a pull request Aug 6, 2024 that will close this issue
2 tasks
@dead-water
Copy link
Member Author

Putting this on hold for now, there was a problem in the live synoptic pipeline ingestion that resulted in not all AIA being downloaded live. This was corrected last week for Heliolab but has yet to be run over the time period July 2023 - July 2024 (inclusive). A almost completed dataset creation script is available at https://github.com/spaceml-org/SDO-FM/blob/webdataset-dataloader/scripts/dataset_construction/make_sdoml_webdataset.py

Things that need to be completed are:

Nice to haves that would be required for a Phase B:

  • The Zarr dataset could be converted
  • Eventually the complete 3min cadence downloaded

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant