Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retrieve validation issues from FAIL_DATA.json #19

Open
volkcj opened this issue Jun 23, 2017 · 1 comment
Open

Retrieve validation issues from FAIL_DATA.json #19

volkcj opened this issue Jun 23, 2017 · 1 comment

Comments

@volkcj
Copy link
Contributor

volkcj commented Jun 23, 2017

SFR and crews need an efficient way to review validation errors. I believe we've discussed pulling these into Workbench.

@MattReimer
Copy link
Member

@volkcj just a point of clarification. Title implies we'll be harvesting this information from cloudwatch. I think that's probably not a good idea.

We have options:

  1. Get it directly from the S3 validation XML files. The risk here is that old XML files aren't currently cleaned up on new runs so you might be seeing stale data.
  2. We could parse more than just the pass/fail status into a metric schema

I'm leaning toward (2) as the best option here. We even already have a metric schema set up for this:

https://github.com/SouthForkResearch/CHaMP_Metrics/blob/master/xml/TopoVisitValidation.xml

It needs to be filled out and then everything to do with validation can be harvested off the API.

Thoughts?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants