Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Fleet] Improve policy_secrets test suite performance #193359

Merged
merged 4 commits into from
Sep 19, 2024

Conversation

nchaulet
Copy link
Member

@nchaulet nchaulet commented Sep 18, 2024

Summary

Related to #191924

While investigating the flakyness around those API integration test I found them pretty slow to run, that PR attempt to Improve test suite performance for policy_secrets, a lot of those tests where perfoming the same action again in a beforeEach and checkin the result, that PR change that to improve the perofmance

This was ran against the flaky test runner and seems to work as expected.

Before

Screenshot 2024-09-19 at 9 09 50 AM

After

Screenshot 2024-09-19 at 9 26 28 AM

@obltmachine
Copy link

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
  • run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#6975

[❌] x-pack/test/fleet_api_integration/config.epm.ts: 0/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#6976

[✅] x-pack/test/fleet_api_integration/config.epm.ts: 100/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#6977

[✅] x-pack/test/fleet_api_integration/config.epm.ts: 100/100 tests passed.

see run history

@nchaulet nchaulet changed the title [Fleet] Test flakyness [Fleet] Improve policy_secrets test suite performance Sep 19, 2024
@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#6982

[✅] x-pack/test/fleet_api_integration/config.fleet.ts: 100/100 tests passed.

see run history

@nchaulet nchaulet marked this pull request as ready for review September 19, 2024 15:36
@nchaulet nchaulet requested a review from a team as a code owner September 19, 2024 15:36
@botelastic botelastic bot added the Team:Fleet Team label for Observability Data Collection Fleet team label Sep 19, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/fleet (Team:Fleet)

@nchaulet nchaulet added release_note:skip Skip the PR/issue when compiling release notes backport:prev-minor Backport to (8.x) the previous minor version (i.e. one version back from main) v8.16.0 labels Sep 19, 2024
@nchaulet
Copy link
Member Author

@elasticmachine merge upstream

@kibana-ci
Copy link
Collaborator

💚 Build Succeeded

Metrics [docs]

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@nchaulet nchaulet merged commit 8bd9085 into elastic:main Sep 19, 2024
20 checks passed
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Sep 19, 2024
@kibanamachine
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.x

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Sep 19, 2024
…#193476)

# Backport

This will backport the following commits from `main` to `8.x`:
- [[Fleet] Improve policy_secrets test suite performance
(#193359)](#193359)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Nicolas
Chaulet","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-09-19T19:39:46Z","message":"[Fleet]
Improve policy_secrets test suite performance
(#193359)","sha":"8bd90857ed667cbbcbe46041a4518366baa57883","branchLabelMapping":{"^v9.0.0$":"main","^v8.16.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team:Fleet","v9.0.0","backport:prev-minor","v8.16.0"],"title":"[Fleet]
Improve policy_secrets test suite
performance","number":193359,"url":"https://github.com/elastic/kibana/pull/193359","mergeCommit":{"message":"[Fleet]
Improve policy_secrets test suite performance
(#193359)","sha":"8bd90857ed667cbbcbe46041a4518366baa57883"}},"sourceBranch":"main","suggestedTargetBranches":["8.x"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/193359","number":193359,"mergeCommit":{"message":"[Fleet]
Improve policy_secrets test suite performance
(#193359)","sha":"8bd90857ed667cbbcbe46041a4518366baa57883"}},{"branch":"8.x","label":"v8.16.0","branchLabelMappingKey":"^v8.16.0$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Nicolas Chaulet <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:prev-minor Backport to (8.x) the previous minor version (i.e. one version back from main) release_note:skip Skip the PR/issue when compiling release notes Team:Fleet Team label for Observability Data Collection Fleet team v8.16.0 v9.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants