-
Notifications
You must be signed in to change notification settings - Fork 8.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Security GenAI] Fix and un-skip Knowledge Base Integration Tests #198861
Conversation
Pinging @elastic/security-solution (Team: SecuritySolution) |
Looks good, will approve pending flakey test runner results! https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7329 |
Flaky Test Runner Stats🎉 All tests passed! - kibana-flaky-test-suite-runner#7329[✅] x-pack/test/security_solution_api_integration/test_suites/genai/knowledge_base/entries/trial_license_complete_tier/configs/ess.config.ts: 50/50 tests passed. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nicely done, thanks for the fix!
💛 Build succeeded, but was flaky
Failed CI StepsMetrics [docs]
cc @e40pud |
Starting backport for target branches: 8.16, 8.x |
…astic#198861) ## Summary This is a followup to elastic#198178 where we skipped KB integration tests. We enable it with this PR. Since it takes a lot of time to setup all Security Labs docs, the idea is to skip installing those docs when it is not needed. For these tests we need to make sure that inference endpoint is setup correctly - labs docs are not required in this case. cc @stephmilovic (cherry picked from commit 69c1e5a)
…astic#198861) ## Summary This is a followup to elastic#198178 where we skipped KB integration tests. We enable it with this PR. Since it takes a lot of time to setup all Security Labs docs, the idea is to skip installing those docs when it is not needed. For these tests we need to make sure that inference endpoint is setup correctly - labs docs are not required in this case. cc @stephmilovic (cherry picked from commit 69c1e5a)
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
…sts (#198861) (#198889) # Backport This will backport the following commits from `main` to `8.16`: - [[Security GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)](#198861) <!--- Backport version: 9.4.3 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sqren/backport) <!--BACKPORT [{"author":{"name":"Ievgen Sorokopud","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-11-05T07:40:59Z","message":"[Security GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)\n\n## Summary\r\n\r\nThis is a followup to https://github.com/elastic/kibana/pull/198178\r\nwhere we skipped KB integration tests. We enable it with this PR.\r\n\r\nSince it takes a lot of time to setup all Security Labs docs, the idea\r\nis to skip installing those docs when it is not needed. For these tests\r\nwe need to make sure that inference endpoint is setup correctly - labs\r\ndocs are not required in this case.\r\n\r\ncc @stephmilovic","sha":"69c1e5a7dda2708773dfeed2314b0ef74f4537ee","branchLabelMapping":{"^v9.0.0$":"main","^v8.17.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","Team: SecuritySolution","Team:Security Generative AI","backport:version","v8.17.0","v8.16.1"],"title":"[Security GenAI] Fix and un-skip Knowledge Base Integration Tests","number":198861,"url":"https://github.com/elastic/kibana/pull/198861","mergeCommit":{"message":"[Security GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)\n\n## Summary\r\n\r\nThis is a followup to https://github.com/elastic/kibana/pull/198178\r\nwhere we skipped KB integration tests. We enable it with this PR.\r\n\r\nSince it takes a lot of time to setup all Security Labs docs, the idea\r\nis to skip installing those docs when it is not needed. For these tests\r\nwe need to make sure that inference endpoint is setup correctly - labs\r\ndocs are not required in this case.\r\n\r\ncc @stephmilovic","sha":"69c1e5a7dda2708773dfeed2314b0ef74f4537ee"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/198861","number":198861,"mergeCommit":{"message":"[Security GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)\n\n## Summary\r\n\r\nThis is a followup to https://github.com/elastic/kibana/pull/198178\r\nwhere we skipped KB integration tests. We enable it with this PR.\r\n\r\nSince it takes a lot of time to setup all Security Labs docs, the idea\r\nis to skip installing those docs when it is not needed. For these tests\r\nwe need to make sure that inference endpoint is setup correctly - labs\r\ndocs are not required in this case.\r\n\r\ncc @stephmilovic","sha":"69c1e5a7dda2708773dfeed2314b0ef74f4537ee"}},{"branch":"8.x","label":"v8.17.0","branchLabelMappingKey":"^v8.17.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: Ievgen Sorokopud <[email protected]>
…ts (#198861) (#198890) # Backport This will backport the following commits from `main` to `8.x`: - [[Security GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)](#198861) <!--- Backport version: 9.4.3 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sqren/backport) <!--BACKPORT [{"author":{"name":"Ievgen Sorokopud","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-11-05T07:40:59Z","message":"[Security GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)\n\n## Summary\r\n\r\nThis is a followup to https://github.com/elastic/kibana/pull/198178\r\nwhere we skipped KB integration tests. We enable it with this PR.\r\n\r\nSince it takes a lot of time to setup all Security Labs docs, the idea\r\nis to skip installing those docs when it is not needed. For these tests\r\nwe need to make sure that inference endpoint is setup correctly - labs\r\ndocs are not required in this case.\r\n\r\ncc @stephmilovic","sha":"69c1e5a7dda2708773dfeed2314b0ef74f4537ee","branchLabelMapping":{"^v9.0.0$":"main","^v8.17.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","Team: SecuritySolution","Team:Security Generative AI","backport:version","v8.17.0","v8.16.1"],"title":"[Security GenAI] Fix and un-skip Knowledge Base Integration Tests","number":198861,"url":"https://github.com/elastic/kibana/pull/198861","mergeCommit":{"message":"[Security GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)\n\n## Summary\r\n\r\nThis is a followup to https://github.com/elastic/kibana/pull/198178\r\nwhere we skipped KB integration tests. We enable it with this PR.\r\n\r\nSince it takes a lot of time to setup all Security Labs docs, the idea\r\nis to skip installing those docs when it is not needed. For these tests\r\nwe need to make sure that inference endpoint is setup correctly - labs\r\ndocs are not required in this case.\r\n\r\ncc @stephmilovic","sha":"69c1e5a7dda2708773dfeed2314b0ef74f4537ee"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/198861","number":198861,"mergeCommit":{"message":"[Security GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)\n\n## Summary\r\n\r\nThis is a followup to https://github.com/elastic/kibana/pull/198178\r\nwhere we skipped KB integration tests. We enable it with this PR.\r\n\r\nSince it takes a lot of time to setup all Security Labs docs, the idea\r\nis to skip installing those docs when it is not needed. For these tests\r\nwe need to make sure that inference endpoint is setup correctly - labs\r\ndocs are not required in this case.\r\n\r\ncc @stephmilovic","sha":"69c1e5a7dda2708773dfeed2314b0ef74f4537ee"}},{"branch":"8.x","label":"v8.17.0","branchLabelMappingKey":"^v8.17.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: Ievgen Sorokopud <[email protected]>
Summary
This is a followup to #198178 where we skipped KB integration tests. We enable it with this PR.
Since it takes a lot of time to setup all Security Labs docs, the idea is to skip installing those docs when it is not needed. For these tests we need to make sure that inference endpoint is setup correctly - labs docs are not required in this case.
cc @stephmilovic