Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Security GenAI] Fix and un-skip Knowledge Base Integration Tests #198861

Merged
merged 1 commit into from
Nov 5, 2024

Conversation

e40pud
Copy link
Contributor

@e40pud e40pud commented Nov 4, 2024

Summary

This is a followup to #198178 where we skipped KB integration tests. We enable it with this PR.

Since it takes a lot of time to setup all Security Labs docs, the idea is to skip installing those docs when it is not needed. For these tests we need to make sure that inference endpoint is setup correctly - labs docs are not required in this case.

cc @stephmilovic

@e40pud e40pud added release_note:skip Skip the PR/issue when compiling release notes v9.0.0 Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:Security Generative AI Security Generative AI backport:version Backport to applied version labels v8.17.0 v8.16.1 labels Nov 4, 2024
@e40pud e40pud self-assigned this Nov 4, 2024
@e40pud e40pud requested a review from a team as a code owner November 4, 2024 20:59
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

@stephmilovic
Copy link
Contributor

Looks good, will approve pending flakey test runner results! https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/7329

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#7329

[✅] x-pack/test/security_solution_api_integration/test_suites/genai/knowledge_base/entries/trial_license_complete_tier/configs/ess.config.ts: 50/50 tests passed.
[✅] x-pack/test/security_solution_api_integration/test_suites/genai/knowledge_base/entries/trial_license_complete_tier/configs/serverless.config.ts: 50/50 tests passed.

see run history

Copy link
Contributor

@stephmilovic stephmilovic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nicely done, thanks for the fix!

@elasticmachine
Copy link
Contributor

💛 Build succeeded, but was flaky

Failed CI Steps

Metrics [docs]

✅ unchanged

cc @e40pud

@e40pud e40pud merged commit 69c1e5a into elastic:main Nov 5, 2024
54 checks passed
@kibanamachine
Copy link
Contributor

Starting backport for target branches: 8.16, 8.x

https://github.com/elastic/kibana/actions/runs/11679633773

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Nov 5, 2024
…astic#198861)

## Summary

This is a followup to elastic#198178
where we skipped KB integration tests. We enable it with this PR.

Since it takes a lot of time to setup all Security Labs docs, the idea
is to skip installing those docs when it is not needed. For these tests
we need to make sure that inference endpoint is setup correctly - labs
docs are not required in this case.

cc @stephmilovic

(cherry picked from commit 69c1e5a)
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Nov 5, 2024
…astic#198861)

## Summary

This is a followup to elastic#198178
where we skipped KB integration tests. We enable it with this PR.

Since it takes a lot of time to setup all Security Labs docs, the idea
is to skip installing those docs when it is not needed. For these tests
we need to make sure that inference endpoint is setup correctly - labs
docs are not required in this case.

cc @stephmilovic

(cherry picked from commit 69c1e5a)
@kibanamachine
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.16
8.x

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Nov 5, 2024
…sts (#198861) (#198889)

# Backport

This will backport the following commits from `main` to `8.16`:
- [[Security GenAI] Fix and un-skip Knowledge Base Integration Tests
(#198861)](#198861)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Ievgen
Sorokopud","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-11-05T07:40:59Z","message":"[Security
GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)\n\n##
Summary\r\n\r\nThis is a followup to
https://github.com/elastic/kibana/pull/198178\r\nwhere we skipped KB
integration tests. We enable it with this PR.\r\n\r\nSince it takes a
lot of time to setup all Security Labs docs, the idea\r\nis to skip
installing those docs when it is not needed. For these tests\r\nwe need
to make sure that inference endpoint is setup correctly - labs\r\ndocs
are not required in this case.\r\n\r\ncc
@stephmilovic","sha":"69c1e5a7dda2708773dfeed2314b0ef74f4537ee","branchLabelMapping":{"^v9.0.0$":"main","^v8.17.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","Team:
SecuritySolution","Team:Security Generative
AI","backport:version","v8.17.0","v8.16.1"],"title":"[Security GenAI]
Fix and un-skip Knowledge Base Integration
Tests","number":198861,"url":"https://github.com/elastic/kibana/pull/198861","mergeCommit":{"message":"[Security
GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)\n\n##
Summary\r\n\r\nThis is a followup to
https://github.com/elastic/kibana/pull/198178\r\nwhere we skipped KB
integration tests. We enable it with this PR.\r\n\r\nSince it takes a
lot of time to setup all Security Labs docs, the idea\r\nis to skip
installing those docs when it is not needed. For these tests\r\nwe need
to make sure that inference endpoint is setup correctly - labs\r\ndocs
are not required in this case.\r\n\r\ncc
@stephmilovic","sha":"69c1e5a7dda2708773dfeed2314b0ef74f4537ee"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/198861","number":198861,"mergeCommit":{"message":"[Security
GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)\n\n##
Summary\r\n\r\nThis is a followup to
https://github.com/elastic/kibana/pull/198178\r\nwhere we skipped KB
integration tests. We enable it with this PR.\r\n\r\nSince it takes a
lot of time to setup all Security Labs docs, the idea\r\nis to skip
installing those docs when it is not needed. For these tests\r\nwe need
to make sure that inference endpoint is setup correctly - labs\r\ndocs
are not required in this case.\r\n\r\ncc
@stephmilovic","sha":"69c1e5a7dda2708773dfeed2314b0ef74f4537ee"}},{"branch":"8.x","label":"v8.17.0","branchLabelMappingKey":"^v8.17.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Ievgen Sorokopud <[email protected]>
kibanamachine added a commit that referenced this pull request Nov 5, 2024
…ts (#198861) (#198890)

# Backport

This will backport the following commits from `main` to `8.x`:
- [[Security GenAI] Fix and un-skip Knowledge Base Integration Tests
(#198861)](#198861)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Ievgen
Sorokopud","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-11-05T07:40:59Z","message":"[Security
GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)\n\n##
Summary\r\n\r\nThis is a followup to
https://github.com/elastic/kibana/pull/198178\r\nwhere we skipped KB
integration tests. We enable it with this PR.\r\n\r\nSince it takes a
lot of time to setup all Security Labs docs, the idea\r\nis to skip
installing those docs when it is not needed. For these tests\r\nwe need
to make sure that inference endpoint is setup correctly - labs\r\ndocs
are not required in this case.\r\n\r\ncc
@stephmilovic","sha":"69c1e5a7dda2708773dfeed2314b0ef74f4537ee","branchLabelMapping":{"^v9.0.0$":"main","^v8.17.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","Team:
SecuritySolution","Team:Security Generative
AI","backport:version","v8.17.0","v8.16.1"],"title":"[Security GenAI]
Fix and un-skip Knowledge Base Integration
Tests","number":198861,"url":"https://github.com/elastic/kibana/pull/198861","mergeCommit":{"message":"[Security
GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)\n\n##
Summary\r\n\r\nThis is a followup to
https://github.com/elastic/kibana/pull/198178\r\nwhere we skipped KB
integration tests. We enable it with this PR.\r\n\r\nSince it takes a
lot of time to setup all Security Labs docs, the idea\r\nis to skip
installing those docs when it is not needed. For these tests\r\nwe need
to make sure that inference endpoint is setup correctly - labs\r\ndocs
are not required in this case.\r\n\r\ncc
@stephmilovic","sha":"69c1e5a7dda2708773dfeed2314b0ef74f4537ee"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/198861","number":198861,"mergeCommit":{"message":"[Security
GenAI] Fix and un-skip Knowledge Base Integration Tests (#198861)\n\n##
Summary\r\n\r\nThis is a followup to
https://github.com/elastic/kibana/pull/198178\r\nwhere we skipped KB
integration tests. We enable it with this PR.\r\n\r\nSince it takes a
lot of time to setup all Security Labs docs, the idea\r\nis to skip
installing those docs when it is not needed. For these tests\r\nwe need
to make sure that inference endpoint is setup correctly - labs\r\ndocs
are not required in this case.\r\n\r\ncc
@stephmilovic","sha":"69c1e5a7dda2708773dfeed2314b0ef74f4537ee"}},{"branch":"8.x","label":"v8.17.0","branchLabelMappingKey":"^v8.17.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Ievgen Sorokopud <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:version Backport to applied version labels release_note:skip Skip the PR/issue when compiling release notes Team:Security Generative AI Security Generative AI Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. v8.16.0 v8.16.1 v8.17.0 v9.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants