Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Preprocess: Error and jobs progression handling #988

Open
msilvafe opened this issue Oct 3, 2024 · 0 comments
Open

Preprocess: Error and jobs progression handling #988

msilvafe opened this issue Oct 3, 2024 · 0 comments

Comments

@msilvafe
Copy link
Contributor

msilvafe commented Oct 3, 2024

We need to implement better error handling and process progress tracking. Currently we write to an "error_log" but whole obs will be skipped if a single group hits an error state. We would like to be able to progress through possible groups and keep track of which ones fail and why. We also want to skip these if we rerun the script, because currently we have to fail on them every time. This could use integration with @mhasself's JobDb currently in PR: #851

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant