Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create and upload junit-xml artifacts #617

Merged
merged 8 commits into from
Aug 26, 2024
Merged

Create and upload junit-xml artifacts #617

merged 8 commits into from
Aug 26, 2024

Conversation

dandavison
Copy link
Contributor

@dandavison dandavison commented Aug 20, 2024

With this PR we start storing junit-xml output from test runs, in order to allow tools to be used to display and query test data. Given appropriate tools, this should have some advantages, e.g.

  • understanding patterns of flakiness in tests across matrix builds within a run, and across runs
  • easier understanding of how one particular build has failed

@dandavison dandavison force-pushed the junit-xml branch 4 times, most recently from e0cc93f to 32b8824 Compare August 25, 2024 15:21
@dandavison dandavison marked this pull request as ready for review August 26, 2024 10:15
@dandavison dandavison requested a review from a team as a code owner August 26, 2024 10:15
@dandavison dandavison enabled auto-merge (squash) August 26, 2024 14:26
@dandavison dandavison merged commit 4e97841 into main Aug 26, 2024
12 checks passed
@dandavison dandavison deleted the junit-xml branch August 26, 2024 19:10
dandavison added a commit to temporalio/cli that referenced this pull request Aug 30, 2024
This PR switches the tests in CI to dump junit XML files. To do so, it
switches to use https://github.com/gotestyourself/gotestsum as the test
runner. (This is what the server repo uses also). An example of a build
with test failures is here:
https://github.com/temporalio/cli/actions/runs/10631569269/job/29472736222

As in temporalio/sdk-python#617, the motivation
for this is that, given appropriate tools, it will make it easier for us
to study patterns of flakiness, test timings etc, across matrix builds
within a run, and across runs.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants