Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Cypress] Transaction details tests fix #199391

Merged
merged 15 commits into from
Dec 3, 2024

Conversation

bryce-b
Copy link
Contributor

@bryce-b bryce-b commented Nov 7, 2024

Summary

This PR re-enables the Transaction details cypress test, which was disabled due to flakiness. The majority of the tests in this file needed an increased timeout to run correctly. However, the 'Show top errors table' test remains disabled, because it will consistently fail in buildkite executing .contains('a', '[MockError] Foo'). This is unreproducible locally, and no amount of refactoring or re-configuring seems to affect the outcome.

Checklist

Delete any items that are not applicable to this PR.

@bryce-b bryce-b changed the title Transaction details tests fix [Cypress] Transaction details tests fix Nov 7, 2024
@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#7365

[❌] APM - Cypress: 0/25 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#7368

[❌] APM - Cypress: 1/25 tests passed.

see run history

@bryce-b bryce-b added the apm:cypress-record cypress test runs will be recorded to the cypress dashboard label Nov 9, 2024
@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#7376

[❌] APM - Cypress: 0/25 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#7377

[❌] APM - Cypress: 1/25 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#7400

[❌] APM - Cypress: 3/25 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#7430

[❌] APM - Cypress: 1/25 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#7431

[❌] APM - Cypress: 0/25 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#7444

[❌] APM - Cypress: 3/25 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#7449

[❌] APM - Cypress: 3/25 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#7451

[❌] APM - Cypress: 2/25 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#7543

[✅] APM - Cypress: 25/25 tests passed.

see run history

@bryce-b bryce-b marked this pull request as ready for review December 2, 2024 22:28
@bryce-b bryce-b requested a review from a team as a code owner December 2, 2024 22:28
@botelastic botelastic bot added ci:project-deploy-observability Create an Observability project Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team labels Dec 2, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-infra_services-team (Team:obs-ux-infra_services)

Copy link
Contributor

github-actions bot commented Dec 2, 2024

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
  • run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

@bryce-b bryce-b added release_note:skip Skip the PR/issue when compiling release notes backport:skip This commit does not require backporting labels Dec 2, 2024
@elasticmachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

@bryce-b bryce-b merged commit 59da2df into elastic:main Dec 3, 2024
16 checks passed
@bryce-b bryce-b deleted the transaction-details-tests-fix branch December 4, 2024 20:56
hop-dev pushed a commit to hop-dev/kibana that referenced this pull request Dec 5, 2024
## Summary
This PR re-enables the Transaction details cypress test, which was
disabled due to flakiness. The majority of the tests in this file needed
an increased timeout to run correctly. However, the 'Show top errors
table' test remains disabled, because it will consistently fail in
buildkite executing `.contains('a', '[MockError] Foo')`. This is
unreproducible locally, and no amount of refactoring or re-configuring
seems to affect the outcome.

### Checklist

Delete any items that are not applicable to this PR.

- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed
CAWilson94 pushed a commit to CAWilson94/kibana that referenced this pull request Dec 9, 2024
## Summary
This PR re-enables the Transaction details cypress test, which was
disabled due to flakiness. The majority of the tests in this file needed
an increased timeout to run correctly. However, the 'Show top errors
table' test remains disabled, because it will consistently fail in
buildkite executing `.contains('a', '[MockError] Foo')`. This is
unreproducible locally, and no amount of refactoring or re-configuring
seems to affect the outcome.

### Checklist

Delete any items that are not applicable to this PR.

- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed
CAWilson94 pushed a commit to CAWilson94/kibana that referenced this pull request Dec 12, 2024
## Summary
This PR re-enables the Transaction details cypress test, which was
disabled due to flakiness. The majority of the tests in this file needed
an increased timeout to run correctly. However, the 'Show top errors
table' test remains disabled, because it will consistently fail in
buildkite executing `.contains('a', '[MockError] Foo')`. This is
unreproducible locally, and no amount of refactoring or re-configuring
seems to affect the outcome.

### Checklist

Delete any items that are not applicable to this PR.

- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
apm:cypress-record cypress test runs will be recorded to the cypress dashboard backport:skip This commit does not require backporting ci:project-deploy-observability Create an Observability project release_note:skip Skip the PR/issue when compiling release notes Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team v9.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants