Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix flaky compatibility tests #101

Open
1 task done
surchs opened this issue Jan 6, 2025 · 0 comments
Open
1 task done

Fix flaky compatibility tests #101

surchs opened this issue Jan 6, 2025 · 0 comments

Comments

@surchs
Copy link
Contributor

surchs commented Jan 6, 2025

Is there an existing issue for this?

  • I have searched the existing issues

Expected Behavior

The version compatibility tests only fail if there is indeed a version incompatibility (in latest or nightly)

Current Behavior

The compatibility tests fail in a flaky way, leading to excessive failure messages and alarm fatigue

Error message

Seems to be linked to timeout issues:

  3 passing (22s)
  1 failing

  1) Full stack e2e
       Query tool:
     AssertionError: Timed out retrying after 4000ms: Expected to find element: `[data-cy="result-container"]`, but never found it.
      at Context.eval (webpack:///./cypress/e2e/simple-test.cy.js:8:7)

e.g. https://github.com/neurobagel/recipes/actions/runs/12637208692/job/35210907142

Environment

https://github.com/neurobagel/recipes/actions/workflows/compatibility.yaml

How to reproduce

No response

Anything else?

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

1 participant