-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Maven mgs #200
Conversation
Download MAVEN data from CDAWeb and use pysatNASA
Merge branch 'develop' into maven_mgs
switching kp to insitu
It looks like a new dataset for ISS FPMU was uploaded, which is breaking the tests here. Out of scope for this PR. |
Added Issue #201 to cover the ISS FPMU bug. This is an upstream issue, so ignore it for the time being in the tests. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is looking good. Instruments load data and metadata as expected.
Some style suggestions and updates based on the latest version. Examples applied to the insitu
instrument, but changes should be similar for the others as well.
Also, please update the documentation for supported instruments: https://github.com/pysat/pysatNASA/blob/maven_mgs/docs/supported_instruments.rst
Thanks for putting this together!
Pinging @JonathonMSmith to see if the new |
The issue is with the general cleaning routine. fix incoming... |
STY Co-authored-by: Jeff Klenzing <[email protected]>
'/cdfs/{year:04d}/{month:02d}')), | ||
'fname': fname} | ||
download_tags = {'': {'': basic_tag}} | ||
download = functools.partial(cdw.download, supported_tags=download_tags) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Since none of these datasets have monthly files this is good, but should we use the cdasws interface for MAVEN.
I'm still not sure that the cdasws interface is ideal for all of our NASA instruments but I can put together some suggestions if we want to use it here.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'll put together a pull to fix the clean routines
# Check for symmetric dims | ||
# Indicates transformation matrix, xarray cannot broadcast | ||
if self.pandas_format: | ||
# True by default | ||
unique_dims = True | ||
else: | ||
# Check for multiple dims | ||
unique_dims = len(self[key].dims) == len(np.unique(self[key].dims)) | ||
# Skip over the coordinates when cleaning | ||
if key not in coords: | ||
if key not in coords and unique_dims: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Change to allow a list of variables to skip as an optional kwarg.
Co-authored-by: Jeff Klenzing <[email protected]>
Removal of the sep tag ''. Change of insitu to insitu_kp. Resulting necessary STY changes for flake.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Clean routine incoming via pull request. A few suggestions here, otherwise looking good and working as expected.
Noting that there are a few instances where the time index is NaN in the sep file.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One more change: The standard elsewhere has been to have a mission-level reference that gets added to each instrument (this happens in the standard init
routine). Since insitu_kp
is copying multiple instruments, leaving this blank and just using the mission level is probably fine here.
Co-authored-by: Jeff Klenzing <[email protected]>
BUG: MAVEN general clean routine fix
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Minor updates, looking good.
Co-authored-by: Jeff Klenzing <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good!
Description
Addresses #(issue)
Adds MAVEN pysat compatibility (No specific issue number).
Type of change
Please delete options that are not relevant.
How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide
instructions so we can reproduce. Please also list any relevant details for
your test configuration
Test Configuration:
Checklist:
develop
(notmain
) branchCHANGELOG.md
, summarizing the changesIf this is a release PR, replace the first item of the above checklist with the release
checklist on the wiki: https://github.com/pysat/pysat/wiki/Checklist-for-Release