Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reworking how ingest_spectrum works using the ORM #4

Conversation

dr-rodriguez
Copy link

This is attempting to rework how ingest_spectrum functions by utilizing the ORM and removing extra checks.

Some of the tests were failing since there are explicit strings that were being checked- they "bad" examples still fail, they just do so for other reasons or the string output is different. Some test cleanup may be needed.

We may also want to consider expanding the cleanup and/or revisit the use of flags

@dr-rodriguez
Copy link
Author

dr-rodriguez commented May 14, 2024

Could also set it to merge into SIMPLE-AstroDB:main but if you wanted to use this for your branch first, this may be one way to do it.

As a note, this does pass our tests but the automated pipeline will likely only run if merging against SIMPLE-AstroDB.

@kelle
Copy link
Owner

kelle commented May 15, 2024

Love this! I was working on it last night and ended up almost in the same place for catching missing values (eg, regime is required). :)

Question: how do we validate
the foreign key constraints? Eg, that the provided regime is in the Regimes table? Unfortunately, the error thrown is a generic Foreign Key constraint error and doesn't say which field is the culprit

dr-rodriguez and others added 2 commits June 12, 2024 09:33
* Create requirements.txt file

* Removing old files and updating documentation

* Updating tests to use requirements.txt

* add explicit python vs command line

* fix numbering.

---------

Co-authored-by: Kelle Cruz <[email protected]>
@dr-rodriguez
Copy link
Author

Withdrawn in favor of SIMPLE-AstroDB#501

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants