Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Flaky Test #592

Open
AjayThorve opened this issue Apr 11, 2024 · 0 comments
Open

[BUG] Flaky Test #592

AjayThorve opened this issue Apr 11, 2024 · 0 comments
Labels
? - Needs Triage Need team to review and classify bug Something isn't working

Comments

@AjayThorve
Copy link
Member

AjayThorve commented Apr 11, 2024

During the CI process, we have identified a flaky test within the cuxfilter/tests/test_dashboard.py module. The test, TestDashBoard::test_variables, intermittently fails with an AssertionError, expecting an empty dictionary but instead receiving {'col_1_chart': '6<=col_1<=9'}. The behavior is inconsistent, with the test passing on most occasions but occasionally failing, as detailed in the CI run 8650157417.

                                               16     16     0%
2024-04-11T16:46:30.6701268Z -------------------------------------------------------------------------------------------
2024-04-11T16:46:30.6702366Z TOTAL                                                                    3774   2797    26%
2024-04-11T16:46:30.6703800Z Coverage XML written to file /__w/cuxfilter/cuxfilter/coverage-results/cuxfilter-coverage.xml
2024-04-11T16:46:30.6704750Z 
2024-04-11T16:46:30.6705125Z =========================== short test summary info ============================
2024-04-11T16:46:30.6729393Z FAILED cuxfilter/tests/test_dashboard.py::TestDashBoard::test_variables - AssertionError: assert {'col_1_chart': '6<=col_1<=9'} == {}
2024-04-11T16:46:30.6730854Z   
2024-04-11T16:46:30.6731281Z   Left contains 1 more item:
2024-04-11T16:46:30.6731972Z   {'col_1_chart': '6<=col_1<=9'}
2024-04-11T16:46:30.6732546Z   
2024-04-11T16:46:30.6732953Z   Full diff:
2024-04-11T16:46:30.6733424Z   - {}
2024-04-11T16:46:30.6733817Z   + {
2024-04-11T16:46:30.6734330Z   +     'col_1_chart': '6<=col_1<=9',
2024-04-11T16:46:30.6734940Z   + }
2024-04-11T16:46:30.6735703Z ============ 1 failed, 155 passed, 53 warnings in 98.68s (0:01:38) =============
2024-04-11T16:46:31.2803345Z /__w/cuxfilter/cuxfilter
2024-04-11T16:46:31.2900363Z
@AjayThorve AjayThorve added bug Something isn't working ? - Needs Triage Need team to review and classify labels Apr 11, 2024
@AjayThorve AjayThorve changed the title [BUG] Fix Flaky Test [BUG] Flaky Test Apr 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
? - Needs Triage Need team to review and classify bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant