Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Entity Analytics API Integration Tests - Serverless - Risk Engine.x-pack/test/security_solution_api_integration/test_suites/entity_analytics/default_license/risk_engine/risk_scoring_task/task_execution·ts - Entity Analytics - Risk Engine @ess @serverless Risk Scoring Task Execution with auditbeat data with some alerts containing hosts and others containing users @skipInQA calculates and persists risk scores for both types of entities #171132

Closed
kibanamachine opened this issue Nov 13, 2023 · 4 comments
Closed

Failing test: Entity Analytics API Integration Tests - Serverless - Risk Engine.x-pack/test/security_solution_api_integration/test_suites/entity_analytics/default_license/risk_engine/risk_scoring_task/task_execution·ts - Entity Analytics - Risk Engine @ess @serverless Risk Scoring Task Execution with auditbeat data with some alerts containing hosts and others containing users @skipInQA calculates and persists risk scores for both types of entities #171132

kibanamachine opened this issue Nov 13, 2023 · 4 comments
Assignees
@rylnd
Labels
8.13 candidate failed-test A test failure on a tracked branch, potentially flaky-test Team:Entity Analytics Security Entity Analytics Team

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Nov 13, 2023 •
edited
Loading

A test failed on a tracked branch

Error: expected 80 to sort of equal 20
    at Assertion.assert (expect.js:100:11)
    at Assertion.eql (expect.js:244:8)
    at Context.<anonymous> (task_execution.ts:222:40)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.apply (wrap_function.js:73:16) {
  actual: '80',
  expected: '20',
  showDiff: true
}

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Nov 13, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Nov 13, 2023
@mistic mistic added the Team:Entity Analytics Security Entity Analytics Team label Nov 14, 2023
@botelastic botelastic bot removed the needs-team Issues missing a team label label Nov 14, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

mistic added a commit that referenced this issue Nov 29, 2023
@mistic
skip flaky suite (#171132)
a01ceb7
@mistic
Copy link
Member

mistic commented Nov 29, 2023

Skipped.

main: a01ceb7

rylnd added a commit to rylnd/kibana that referenced this issue Dec 12, 2023
@rylnd
Fix flaky test around risk task execution
bf50448 
The issue here was that be our assertion that the number of generated
risk scores be EXACTLY 20; in a case where the test runner itself is
slow (but kibana/ES is not), the task can/may execute more than one
time. In the accompanying issue we can see that that's indeed what
happened: the task executed four times, generating 80 alerts, and our
assertion failed.

Closes elastic#171132.
@jaredburgettelastic
Copy link
Contributor

Will be addressed by #172417

@rylnd
Copy link
Contributor

rylnd commented Jan 9, 2024

#172417 is merged to main, and these tests are now back in action. Closing for now.

@rylnd rylnd closed this as completed Jan 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rylnd rylnd

Labels
8.13 candidate failed-test A test failure on a tracked branch, potentially flaky-test Team:Entity Analytics Security Entity Analytics Team
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@rylnd @mistic @kibanamachine @jaredburgettelastic