Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/detection_response/detection_engine/detection_alerts/assignments/assignments·cy·ts - Alert user assignment - ESS & Serverless Basic rendering alert with some assignees in alert's details flyout alert with some assignees in alert's details flyout #172663

Closed
kibanamachine opened this issue Dec 6, 2023 · 6 comments
Closed

Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/detection_response/detection_engine/detection_alerts/assignments/assignments·cy·ts - Alert user assignment - ESS & Serverless Basic rendering alert with some assignees in alert's details flyout alert with some assignees in alert's details flyout #172663

kibanamachine opened this issue Dec 6, 2023 · 6 comments
Assignees
@e40pud
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Detection Engine Security Solution Detection Engine Area

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Dec 6, 2023 •
edited
Loading

A test failed on a tracked branch

AssertionError: Timed out retrying after 150000ms: Expected to find element: `[data-test-subj="alert-assignees-context-menu-item"]`, but never found it.
    at openAlertAssigningActionMenu (webpack:///./tasks/alert_assignments.ts:61:5)
    at updateAssigneesForAlert (webpack:///./tasks/alert_assignments.ts:172:2)
    at Context.eval (webpack:///./e2e/detection_response/detection_engine/detection_alerts/assignments/assignments.cy.ts:87:30)

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Dec 6, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Dec 6, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@mistic mistic added the Team:Detection Engine Security Solution Detection Engine Area label Dec 12, 2023
@botelastic botelastic bot removed the needs-team Issues missing a team label label Dec 12, 2023
mistic added a commit that referenced this issue Dec 12, 2023
@mistic
skip flaky suite (#172663)
1cfe94c
@mistic
Copy link
Member

mistic commented Dec 12, 2023

Skipped.

main: 1cfe94c

e40pud added a commit to e40pud/kibana that referenced this issue Dec 13, 2023
@e40pud
[Security Solution][Detections] Flaky alert assignments tests
ae332ca 
// FLAKY: elastic#172611
// FLAKY: elastic#172623
// FLAKY: elastic#172663
@e40pud e40pud mentioned this issue Dec 13, 2023
Merged
e40pud added a commit that referenced this issue Dec 13, 2023
@e40pud
[Security Solution][Detections] Flaky alert assignments tests (#173284)
17bc0c9 
## Summary

With these changes we fix flaky tests caused by the flakiness of the
alert actions button. There is a [`expandFirstAlertActions`
method](https://github.com/elastic/kibana/blob/main/x-pack/test/security_solution_cypress/cypress/tasks/alerts.ts#L125)
which workarounds this issue.

### Flaky tests:
1. #172611
2. #172623
3. #172663

### Flaky test runner (100 times)

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/4538
@e40pud e40pud self-assigned this Dec 13, 2023
yctercero pushed a commit to yctercero/kibana that referenced this issue Dec 14, 2023
@e40pud
[Security Solution][Detections] Flaky alert assignments tests (elasti…
3e21862 
…c#173284)

## Summary

With these changes we fix flaky tests caused by the flakiness of the
alert actions button. There is a [`expandFirstAlertActions`
method](https://github.com/elastic/kibana/blob/main/x-pack/test/security_solution_cypress/cypress/tasks/alerts.ts#L125)
which workarounds this issue.

### Flaky tests:
1. elastic#172611
2. elastic#172623
3. elastic#172663

### Flaky test runner (100 times)

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/4538
(cherry picked from commit 17bc0c9)

# Conflicts:
#	x-pack/test/security_solution_cypress/cypress/e2e/detection_response/detection_engine/detection_alerts/assignments/assignments.cy.ts
yctercero referenced this issue Dec 14, 2023
@yctercero @e40pud
[8.12] [Security Solution][Detections] Flaky alert assignments tests (#…
726025c 
…173284) (#173344)

# Backport

This will backport the following commits from `main` to `8.12`:
- [[Security Solution][Detections] Flaky alert assignments tests
(#173284)](#173284)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Ievgen
Sorokopud","email":"[email protected]"},"sourceCommit":{"committedDate":"2023-12-13T20:56:12Z","message":"[Security
Solution][Detections] Flaky alert assignments tests (#173284)\n\n##
Summary\r\n\r\nWith these changes we fix flaky tests caused by the
flakiness of the\r\nalert actions button. There is a
[`expandFirstAlertActions`\r\nmethod](https://github.com/elastic/kibana/blob/main/x-pack/test/security_solution_cypress/cypress/tasks/alerts.ts#L125)\r\nwhich
workarounds this issue.\r\n\r\n### Flaky tests:\r\n1.
https://github.com/elastic/kibana/issues/172611\r\n2.
https://github.com/elastic/kibana/issues/172623\r\n3.
https://github.com/elastic/kibana/issues/172663\r\n\r\n### Flaky test
runner (100
times)\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/4538","sha":"17bc0c9fa2f7a2d5d0f3ff0c71f848686f182373","branchLabelMapping":{"^v8.13.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:
SecuritySolution","backport:prev-minor","Team:Detection
Engine","v8.13.0"],"number":173284,"url":"https://github.com/elastic/kibana/pull/173284","mergeCommit":{"message":"[Security
Solution][Detections] Flaky alert assignments tests (#173284)\n\n##
Summary\r\n\r\nWith these changes we fix flaky tests caused by the
flakiness of the\r\nalert actions button. There is a
[`expandFirstAlertActions`\r\nmethod](https://github.com/elastic/kibana/blob/main/x-pack/test/security_solution_cypress/cypress/tasks/alerts.ts#L125)\r\nwhich
workarounds this issue.\r\n\r\n### Flaky tests:\r\n1.
https://github.com/elastic/kibana/issues/172611\r\n2.
https://github.com/elastic/kibana/issues/172623\r\n3.
https://github.com/elastic/kibana/issues/172663\r\n\r\n### Flaky test
runner (100
times)\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/4538","sha":"17bc0c9fa2f7a2d5d0f3ff0c71f848686f182373"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v8.13.0","labelRegex":"^v8.13.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/173284","number":173284,"mergeCommit":{"message":"[Security
Solution][Detections] Flaky alert assignments tests (#173284)\n\n##
Summary\r\n\r\nWith these changes we fix flaky tests caused by the
flakiness of the\r\nalert actions button. There is a
[`expandFirstAlertActions`\r\nmethod](https://github.com/elastic/kibana/blob/main/x-pack/test/security_solution_cypress/cypress/tasks/alerts.ts#L125)\r\nwhich
workarounds this issue.\r\n\r\n### Flaky tests:\r\n1.
https://github.com/elastic/kibana/issues/172611\r\n2.
https://github.com/elastic/kibana/issues/172623\r\n3.
https://github.com/elastic/kibana/issues/172663\r\n\r\n### Flaky test
runner (100
times)\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/4538","sha":"17bc0c9fa2f7a2d5d0f3ff0c71f848686f182373"}}]}]
BACKPORT-->

Co-authored-by: Ievgen Sorokopud <[email protected]>
@yctercero
Copy link
Contributor

Addressed in #173284

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@e40pud e40pud

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Detection Engine Security Solution Detection Engine Area
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@e40pud @mistic @yctercero @kibanamachine