Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement desired approach to error handling of individual migration/rec failures #34

Open
chadlwilson opened this issue Oct 15, 2021 · 1 comment
Open

Implement desired approach to error handling of individual migration/rec failures #34

chadlwilson opened this issue Oct 15, 2021 · 1 comment
Labels
enhancement New feature or request good first issue Good for newcomers size:S small items
Milestone
Implement error h...

Comments

@chadlwilson
Copy link
Collaborator

Context / Goal

We will need to make decisions about how we want failures to be handled and recorded/reported, and which things should be retried.

Expected Outcome

Answer and implement:

  • what should happen if one of the two dataset queries fail or are invalid?
  • what if an individual row fails for some reason? Should the run be abandoned?
  • how should transient errors be addressed? Should the code be able to retry a query in certain situations (network problems etc)
  • how should the failures be reported/recorded? Details in logs? Summary error(s) stored alongside the run results with a status?
  • how should we distinguish between "user" errors (e.g bad configuration of dataset query) vs "system" errors (unexpected bug in the tool/framework)
  • should any (possibly partial) results be removed from the recce DB on failure?

Out of Scope

Additional context / implementation notes
@chadlwilson chadlwilson added the enhancement New feature or request label Oct 15, 2021
@chadlwilson chadlwilson added size:S small items good first issue Good for newcomers labels Nov 9, 2021
@chadlwilson
Copy link
Collaborator Author

Related to #52 (dupe?)

@jordan396-tw jordan396-tw self-assigned this Jun 8, 2022
@jordan396-tw jordan396-tw mentioned this issue Jun 8, 2022
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request good first issue Good for newcomers size:S small items
Projects
None yet
Milestone
Implement error handling mechanism
Development

No branches or pull requests
2 participants
@chadlwilson @jordan396-tw