You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The mwoffliner project has many e2e tests that run in CI and test that the project can actually properly process various live wikis and their data. This is great!
In fact, many of the unit tests themselves are actually e2e tests (see #2057)
However, since the external data itself could cause the tests to fail, and we expect this to happen fairly frequently, it would be useful to have the e2e tests run periodically, perhaps once per day (configurable). This would allow us to catch regressions early and not be "surprised" when trying to submit code and having e2e tests inexplicably failing.
Not sure if GitHub actions has this capability but it seems likely.
For example, this was a problem when trying to submit #2055, since it was blocked by the unrelated failure in #2056.
The text was updated successfully, but these errors were encountered:
audiodude
changed the title
e2e tests shoudl run periodically and generate failure emails
e2e tests should run periodically and generate failure emails
Jul 7, 2024
The mwoffliner project has many e2e tests that run in CI and test that the project can actually properly process various live wikis and their data. This is great!
In fact, many of the unit tests themselves are actually e2e tests (see #2057)
However, since the external data itself could cause the tests to fail, and we expect this to happen fairly frequently, it would be useful to have the e2e tests run periodically, perhaps once per day (configurable). This would allow us to catch regressions early and not be "surprised" when trying to submit code and having e2e tests inexplicably failing.
Not sure if GitHub actions has this capability but it seems likely.
For example, this was a problem when trying to submit #2055, since it was blocked by the unrelated failure in #2056.
The text was updated successfully, but these errors were encountered: