Failing test: Security Solution Cypress.x-pack/plugins/security_solution/cypress/e2e/detection_response/rule_creation/custom_query_rule·cy·ts - Custom query rules Custom detection rules creation Creates and enables a new rule Creates and enables a new rule #163691
Assignees
Labels
failed-test
A test failure on a tracked branch, potentially flaky-test
Team:Detection Engine
Security Solution Detection Engine Area
Team:Detections and Resp
Security Detection Response Team
Team: SecuritySolution
Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc.
triage_needed
Comments
kibanamachine
added
the
failed-test
kibanamachine
added
the
Team:Detection Engine
|
New failure: CI Build - main |
banderror
added
triage_needed
Team:Detections and Resp
|
Pinging @elastic/security-detections-response (Team:Detections and Resp) |
|
Pinging @elastic/security-solution (Team: SecuritySolution) |
|
@yctercero There's a chance #164099 has fixed this test, but we need to double-check |
|
Thanks @banderror ! Checking with flakey test runner https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2971 |
|
Flakiness investigated as part of: #169218 Flaky test runner shows no flakiness for this test on 200 runs. Closing issue but tagging @yctercero and @elastic/security-detection-engine team to keep an eye open on this issue in case it's reopened. Hopefully #164099 fixed this test. |
maximpn
pushed a commit
that referenced
this issue
Oct 24, 2023
…ts and enable Serverless run (#169218) ## Summary Flaky test runner for Cypress tests in: - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/detection_alerts` - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/value_lists` - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation` ## Changes - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/custom_query_rule_data_view.cy.ts` **tagged to run on Serverless** - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/event_correlation_rule.cy.ts` **tagged to run on Serverless** - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/machine_learning_rule.cy.ts` **tagged to run on Serverless** - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/new_terms_rule.cy.ts` **tagged to run on Serverless** - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/override.cy.ts` **tagged to run on Serverless** - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/deletion/rule_delete.cy.ts` **added disableAutorefresh() to avoid flakiness** ## Related failing-test issues ### `detection_response/detection_alerts` 1. #169091 **Marked as `legit-flake` and assigned to @elastic/security-detection-engine** 3. #163885 ### `detection_response/value_lists` 4. #165699 ### `detection_response/rule_creation` 5. #163691 ## Flaky test runner - https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3583 - https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3615 [SERVERLESS ONLY] - https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3656 [Serverless without indicator match and saved queries]
jpdjere
added a commit
to jpdjere/kibana
that referenced
this issue
Oct 24, 2023
…ts and enable Serverless run (elastic#169218) ## Summary Flaky test runner for Cypress tests in: - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/detection_alerts` - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/value_lists` - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation` ## Changes - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/custom_query_rule_data_view.cy.ts` **tagged to run on Serverless** - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/event_correlation_rule.cy.ts` **tagged to run on Serverless** - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/machine_learning_rule.cy.ts` **tagged to run on Serverless** - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/new_terms_rule.cy.ts` **tagged to run on Serverless** - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/override.cy.ts` **tagged to run on Serverless** - `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/deletion/rule_delete.cy.ts` **added disableAutorefresh() to avoid flakiness** ## Related failing-test issues ### `detection_response/detection_alerts` 1. elastic#169091 **Marked as `legit-flake` and assigned to @elastic/security-detection-engine** 3. elastic#163885 ### `detection_response/value_lists` 4. elastic#165699 ### `detection_response/rule_creation` 5. elastic#163691 ## Flaky test runner - https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3583 - https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3615 [SERVERLESS ONLY] - https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3656 [Serverless without indicator match and saved queries] (cherry picked from commit 939c87d)
jpdjere
referenced
this issue
Oct 26, 2023
…ess tests and enable Serverless run (#169218) (#169681) # Backport This will backport the following commits from `main` to `8.11`: - [[Security Solution] Unskip tests for `detection_response` Cypress tests and enable Serverless run (#169218)](#169218) <!--- Backport version: 8.9.8 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sqren/backport) <!--BACKPORT [{"author":{"name":"Juan Pablo Djeredjian","email":"[email protected]"},"sourceCommit":{"committedDate":"2023-10-24T07:18:42Z","message":"[Security Solution] Unskip tests for `detection_response` Cypress tests and enable Serverless run (#169218)\n\n## Summary\r\n\r\nFlaky test runner for Cypress tests in:\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/detection_alerts` \r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/value_lists` \r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation` \r\n\r\n## Changes\r\n\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/custom_query_rule_data_view.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/event_correlation_rule.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/machine_learning_rule.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/new_terms_rule.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/override.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/deletion/rule_delete.cy.ts` **added disableAutorefresh() to avoid flakiness**\r\n\r\n## Related failing-test issues\r\n\r\n### `detection_response/detection_alerts`\r\n1. https://github.com/elastic/kibana/issues/169091\r\n**Marked as `legit-flake` and assigned to @elastic/security-detection-engine** \r\n3. https://github.com/elastic/kibana/issues/163885\r\n\r\n### `detection_response/value_lists`\r\n4. https://github.com/elastic/kibana/issues/165699\r\n\r\n### `detection_response/rule_creation`\r\n5. https://github.com/elastic/kibana/issues/163691\r\n\r\n## Flaky test runner\r\n\r\n- https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3583\r\n- https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3615 [SERVERLESS ONLY]\r\n- https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3656 [Serverless without indicator match and saved queries]","sha":"939c87d95342c61f03c853cb3b34c9f412c303b0","branchLabelMapping":{"^v8.12.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:skip","Team:Detections and Resp","Team:Detection Rule Management","Team:Detection Engine","v8.12.0"],"number":169218,"url":"https://github.com/elastic/kibana/pull/169218","mergeCommit":{"message":"[Security Solution] Unskip tests for `detection_response` Cypress tests and enable Serverless run (#169218)\n\n## Summary\r\n\r\nFlaky test runner for Cypress tests in:\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/detection_alerts` \r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/value_lists` \r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation` \r\n\r\n## Changes\r\n\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/custom_query_rule_data_view.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/event_correlation_rule.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/machine_learning_rule.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/new_terms_rule.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/override.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/deletion/rule_delete.cy.ts` **added disableAutorefresh() to avoid flakiness**\r\n\r\n## Related failing-test issues\r\n\r\n### `detection_response/detection_alerts`\r\n1. https://github.com/elastic/kibana/issues/169091\r\n**Marked as `legit-flake` and assigned to @elastic/security-detection-engine** \r\n3. https://github.com/elastic/kibana/issues/163885\r\n\r\n### `detection_response/value_lists`\r\n4. https://github.com/elastic/kibana/issues/165699\r\n\r\n### `detection_response/rule_creation`\r\n5. https://github.com/elastic/kibana/issues/163691\r\n\r\n## Flaky test runner\r\n\r\n- https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3583\r\n- https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3615 [SERVERLESS ONLY]\r\n- https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3656 [Serverless without indicator match and saved queries]","sha":"939c87d95342c61f03c853cb3b34c9f412c303b0"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v8.12.0","labelRegex":"^v8.12.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/169218","number":169218,"mergeCommit":{"message":"[Security Solution] Unskip tests for `detection_response` Cypress tests and enable Serverless run (#169218)\n\n## Summary\r\n\r\nFlaky test runner for Cypress tests in:\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/detection_alerts` \r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/value_lists` \r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation` \r\n\r\n## Changes\r\n\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/custom_query_rule_data_view.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/event_correlation_rule.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/machine_learning_rule.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/new_terms_rule.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_creation/override.cy.ts` **tagged to run on Serverless**\r\n- `x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/deletion/rule_delete.cy.ts` **added disableAutorefresh() to avoid flakiness**\r\n\r\n## Related failing-test issues\r\n\r\n### `detection_response/detection_alerts`\r\n1. https://github.com/elastic/kibana/issues/169091\r\n**Marked as `legit-flake` and assigned to @elastic/security-detection-engine** \r\n3. https://github.com/elastic/kibana/issues/163885\r\n\r\n### `detection_response/value_lists`\r\n4. https://github.com/elastic/kibana/issues/165699\r\n\r\n### `detection_response/rule_creation`\r\n5. https://github.com/elastic/kibana/issues/163691\r\n\r\n## Flaky test runner\r\n\r\n- https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3583\r\n- https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3615 [SERVERLESS ONLY]\r\n- https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3656 [Serverless without indicator match and saved queries]","sha":"939c87d95342c61f03c853cb3b34c9f412c303b0"}}]}] BACKPORT--> Co-authored-by: Kibana Machine <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
A test failed on a tracked branch
First failure: CI Build - main
The text was updated successfully, but these errors were encountered: