Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Evaluate tooling for automatic filtering/checking test results #59

Open
mnovak1 opened this issue Nov 27, 2019 · 3 comments
Open

Evaluate tooling for automatic filtering/checking test results #59

mnovak1 opened this issue Nov 27, 2019 · 3 comments
Labels
priority-major

Comments

@mnovak1
Copy link
Member

mnovak1 commented Nov 27, 2019 •
edited
Loading

Main goal of this issue is to choose and start to use tool for automatic test results checking. This tool should allow to filter known issues from test results so there is no need to check them. It should allow to focus to only new issues.

Tool should be close to the test suite (part of it) and publicly available.
@mnovak1 mnovak1 changed the title Evaluate tooling for automatic filtering/checking results from the test suite Evaluate tooling for automatic filtering/checking test results Nov 27, 2019
@mnovak1
Copy link
Member Author

mnovak1 commented Jan 15, 2020

Currently failing tests are ignored but there should be used different way of checking results.

@mnovak1
Copy link
Member Author

mnovak1 commented Jan 15, 2020

For MP pipeline there can be used results-checker and filters for it would be part of the test suite.

@mnovak1
Copy link
Member Author

mnovak1 commented Jan 21, 2020

This issue is currently on hold until global strategy is set.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
priority-major
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mnovak1