-
Notifications
You must be signed in to change notification settings - Fork 8.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Ownership] Assign test files to ml-ui team #200212
Conversation
@elasticmachine merge upstream |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Left a few comments about trying to order new additions with existing entries in this file. Otherwise as the file grows, it becomes harder to spot which paths are already included.
When flapping detection is turned on, alerts that switch | ||
quickly between active and recovered states are identified | ||
as “flapping” and notifications are reduced. | ||
description: When flapping detection is turned on, alerts that switch quickly between active and recovered states are identified as “flapping” and notifications are reduced. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Did you mean to touch this file?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No it wasn't me, it was a ci auto commit.
oas_docs/output/kibana.yaml
Outdated
When flapping detection is turned on, alerts that switch | ||
quickly between active and recovered states are identified | ||
as “flapping” and notifications are reduced. | ||
description: When flapping detection is turned on, alerts that switch quickly between active and recovered states are identified as “flapping” and notifications are reduced. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Did you mean to touch this file?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No it wasn't me, it was a ci auto commit.
.github/CODEOWNERS
Outdated
@@ -1318,6 +1318,10 @@ x-pack/test_serverless/**/test_suites/observability/ai_assistant @elastic/obs-ai | |||
#CC# /src/plugins/kibana_react/public/code_editor/ @elastic/kibana-presentation | |||
|
|||
# Machine Learning | |||
/x-pack/test/functional_with_es_ssl/apps/discover_ml_uptime/config.ts @elastic/ml-ui |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you please group this line with the /x-pack/test/functional_with_es_ssl/apps/discover_ml_uptime/ml/
file a few lines down.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
/x-pack/test/functional_with_es_ssl/apps/discover_ml_uptime/config.ts @elastic/ml-ui | ||
/x-pack/test/stack_functional_integration/apps/ml @elastic/ml-ui | ||
/x-pack/test/functional/fixtures/kbn_archiver/ml @elastic/ml-ui | ||
/x-pack/test/accessibility/apps/group2/ml_* @elastic/ml-ui | ||
/x-pack/test/api_integration/apis/file_upload @elastic/ml-ui | ||
/x-pack/test/accessibility/apps/group2/ml.ts @elastic/ml-ui |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you please group this file with the /x-pack/test/accessibility/apps/group2/ml.ts
entry a few lines down.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
.github/CODEOWNERS
Outdated
@@ -1337,7 +1341,8 @@ x-pack/test_serverless/**/test_suites/observability/ai_assistant @elastic/obs-ai | |||
/x-pack/test/api_integration/services/ml.ts @elastic/ml-ui | |||
|
|||
# Additional plugins and packages maintained by the ML team. | |||
/test/examples/response_stream @elastic/ml-ui | |||
/x-pack/test/functional/services/aiops @elastic/ml-ui |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you please group this file with the /x-pack/test/functional/services/transform/
entry a few lines down.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Adds `mailto:` as an allowed URL Url formatters in data views.
…9963) ### How to test Closes elastic#198977 Part of elastic#193245 This PR contains the changes to migrate `inspect` test folder to deployment-agnostic testing strategy. ### How to test - Serverless ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep="APM" ``` It's recommended to be run against [MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki) - Stateful ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="APM" ``` ## Checks - [ ] (OPTIONAL, only if a test has been unskipped) Run flaky test suite - [x] local run for serverless - [x] local run for stateful - [x] MKI run for serverless
…pty on windows (elastic#199791) ## Summary Bug: On Windows, we can't select TSV files or drag them to the file picker. This error happens because we have a validation for the file type, and for some reason, on Windows, it is an empty string 🤡 . I updated the file validation logic to allow empty strings for file types and added one extra value to the acceptable types, `.tsv`. So, when the mime type checks fail, it will accept any files with the `tsv` extension. I desk-tested it on Windows-edge, Windows-chrome, Mac-chrome and it works. ### How to test it? * ON A WINDOWS MACHINE * Open the security solution app and navigate to the entity store page * Drag a TSV file created on a Windows machine; the file should be accepted * Click on the "select file" button and select a TSV file created on a Windows machine * Both methods should allow you to select the file, and you should be able to proceed with the bulk upload #### Do I need to checkout your code and start kibana? If you are a lazy person like me, you can test the feature using the cloud deployment [here](https://kibana-pr-199791.kb.us-west2.gcp.elastic-cloud.com/app/security/entity_analytics_entity_store). You can get the login/password using Vault. The instructions are on the latest Cloud Deployment link, or ask me for credentials. #### What if I don't have a Windows machine? Buy one. I am kidding. 🤡 You can follow [this tutorial](https://github.com/elastic/security-team/blob/main/tools/sec-eng-prod/sep-vms/README.md#setup) to deploy it to gcloud, and connect to it using RDP. But If you are lazy like me, you can ask me for my Windows 11 cloud deployment credentials. _Obs. You need an app to access the cloud deployment via RDP. The "Windows App" can be easily downloaded from the App Store on Mac._ ### Checklist Delete any items that are not applicable to this PR. - [x] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios - [x] This was checked for [cross-browser compatibility](https://www.elastic.co/support/matrix#matrix_browsers)
## Summary This PR adds support for asserting test equality with kbn-expect. It also introduces some unit tests to kbn-expect in order to verify the changes are working.
## Summary Assign test files to Appex QA Contributes to: elastic#192979 --------- Co-authored-by: Robert Oskamp <[email protected]> Co-authored-by: Elastic Machine <[email protected]>
## Summary Closes elastic#199754 by introducing more fine-grained version getters to get the base version (to resolve to the git tag in the repo), the actual version which might include the IAR suffix and the docker version which replaces + with . For testing, EA host and kubernetes as well as OTel host should be tested. See here: elastic#199758 (comment) --------- Co-authored-by: kibanamachine <[email protected]>
…e `_perform` upgrade API (elastic#199761) **Partially addresses:** elastic#171520 ## Summary This PR integrates Prebuilt Rules Customization UI functionality with the `/internal/detection_engine/prebuilt_rules/upgrade/_perform` Prebuilt Rules Customization upgrade API. > [!CAUTION] > This PR doesn't handle rule type changes. Prebuilt rule updates with rule type change consider having a NON SOLVABLE conflict and won't be upgraded neither individually nor in bulk. Addressing that task requires UI and functional changes and will be addressed in a separate PR. ## Details ## How to test - Clear Elasticsearch data - Run Elasticsearch and Kibana locally (do not open Kibana in a web browser) - Install an outdated version of the `security_detection_engine` Fleet package ```bash curl -X POST --user elastic:changeme -H 'Content-Type: application/json' -H 'kbn-xsrf: 123' -H "elastic-api-version: 2023-10-31" -d '{"force":true}' http://localhost:5601/kbn/api/fleet/epm/packages/security_detection_engine/8.14.1 ``` - Install prebuilt rules ```bash curl -X POST --user elastic:changeme -H 'Content-Type: application/json' -H 'kbn-xsrf: 123' -H "elastic-api-version: 1" -d '{"mode":"ALL_RULES"}' http://localhost:5601/kbn/internal/detection_engine/prebuilt_rules/installation/_perform ``` - Open `Detection Rules (SIEM)` Page -> `Rule Updates` - [ ] Check update functionality in a flyout - Pick a rule - Click on rule's name - Make changes to fields in incoming rule updates updates - Save field(s) changes - Press the `Update` button - [ ] Check table row rule update - Pick a rule - Click on rule's name - Make changes to fields in incoming rule updates updates - Save field(s) changes - Close the flyout - Press the `Update rule` button in the rule's table row - [ ] Check bulk rule update - Pick a few rules and for each of them do the next steps - Click on rule's name - Make changes to fields in incoming rule updates updates - Save field(s) changes - Close the flyout - After press the `Update All` button on the page - [ ] Check selected rules bulk update - Pick a few rules and for each of them do the next steps - Click on rule's name - Make changes to fields in incoming rule updates updates - Save field(s) changes - Close the flyout - After select the modified rule updates - Press the `Update N selected rule(s)` button on the page Co-authored-by: Dmitrii Shevchenko <[email protected]>
…00161) ## Summary This PR removes the `.empty` file from the `test/functional/screenshots` directory as it's no longer needed. ### Details The file has been introduced as part of elastic#14122 when the directory was cleaned. Since then, new base line screenshots have been added, so the directory is no longer empty.
## Summary Fix OAS snapshot --------- Co-authored-by: kibanamachine <[email protected]> Co-authored-by: Elastic Machine <[email protected]>
## Summary Assign test files to search kibana team Contributes to: elastic#192979
…astic#199645) closes elastic#198967 closes elastic#198985 part of elastic#193245 ### How to test - Serverless ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep="APM" ``` - Stateful ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="APM" ``` - [MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki) ### Checklist - [x] (OPTIONAL, only if a test has been unskipped) Run flaky test suite - [x] serverless - [x] stateful - [x] MKI --------- Co-authored-by: Sergi Romeu <[email protected]>
Closes elastic#200037 defaultTheme$ is only used in storybooks. This PR removes defaultTheme$ and replaces it with theme$ available from core start mock.
…y tests (elastic#200022) Closes elastic#192222 ## Summary ### Problem The test appears to be flaky, potentially because the entries are not available at the time of retrieval. This cannot be reproduced locally or via the flaky test runner. (more details [here](elastic#196026 (comment))) ### Solution Add a retry when fetching the instructions and check whether the number of instructions returned by the API endpoint is the same number of instructions expected. ### Checklist - [x] [Flaky Test Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was used on any tests changed
## Summary Adding a Kibana-related breaking change found in the Security release notes.
@elasticmachine merge upstream |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for making those edits. LGTM
💚 Build Succeeded
Metrics [docs]
History
|
## Summary Assign test files to ml-ui team Contributes to: elastic#192979 --------- Co-authored-by: Elastic Machine <[email protected]> Co-authored-by: kibanamachine <[email protected]> Co-authored-by: Graham Hudgins <[email protected]> Co-authored-by: Irene Blanco <[email protected]> Co-authored-by: Pablo Machado <[email protected]> Co-authored-by: Robert Oskamp <[email protected]> Co-authored-by: Joe Reuter <[email protected]> Co-authored-by: Maxim Palenov <[email protected]> Co-authored-by: Dmitrii Shevchenko <[email protected]> Co-authored-by: Nicolas Chaulet <[email protected]> Co-authored-by: Ania Kowalska <[email protected]> Co-authored-by: Milosz Marcinkowski <[email protected]> Co-authored-by: Sergi Romeu <[email protected]> Co-authored-by: Nathan Reese <[email protected]> Co-authored-by: Lisa Cawley <[email protected]> Co-authored-by: Viduni Wickramarachchi <[email protected]> Co-authored-by: wajihaparvez <[email protected]>
## Summary Assign test files to ml-ui team Contributes to: elastic#192979 --------- Co-authored-by: Elastic Machine <[email protected]> Co-authored-by: kibanamachine <[email protected]> Co-authored-by: Graham Hudgins <[email protected]> Co-authored-by: Irene Blanco <[email protected]> Co-authored-by: Pablo Machado <[email protected]> Co-authored-by: Robert Oskamp <[email protected]> Co-authored-by: Joe Reuter <[email protected]> Co-authored-by: Maxim Palenov <[email protected]> Co-authored-by: Dmitrii Shevchenko <[email protected]> Co-authored-by: Nicolas Chaulet <[email protected]> Co-authored-by: Ania Kowalska <[email protected]> Co-authored-by: Milosz Marcinkowski <[email protected]> Co-authored-by: Sergi Romeu <[email protected]> Co-authored-by: Nathan Reese <[email protected]> Co-authored-by: Lisa Cawley <[email protected]> Co-authored-by: Viduni Wickramarachchi <[email protected]> Co-authored-by: wajihaparvez <[email protected]>
Summary
Assign test files to ml-ui team
Contributes to: #192979