[ObsUX][APM] Migration of Service Overview tests to deployment agnostic approach #200226
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
@elasticmachine merge upstream |
Bluefinger
force-pushed
the
service-overview-test-migration
branch
from
3f19bfb to
c796c05
Compare
|
/ci |
Bluefinger
added
release_note:skip
|
Pinging @elastic/obs-ux-infra_services-team (Team:obs-ux-infra_services) |
Bluefinger
force-pushed
the
service-overview-test-migration
branch
from
6a307e0 to
9415f14
Compare
botelastic
bot
added
the
ci:project-deploy-observability
🤖 GitHub commentsExpand to view the GitHub comments
Just comment with:
|
jennypavlova
approved these changes
Nov 19, 2024
...gration/deployment_agnostic/apis/observability/apm/service_overview/instance_details.spec.ts
Outdated
Show resolved
Hide resolved
...gration/deployment_agnostic/apis/observability/apm/service_overview/instance_details.spec.ts
Outdated
Show resolved
Hide resolved
dmlemeshko
reviewed
Nov 19, 2024
...ation/deployment_agnostic/apis/observability/apm/service_overview/dependencies/index.spec.ts
Outdated
Show resolved
Hide resolved
dmlemeshko
reviewed
Nov 19, 2024
...yment_agnostic/apis/observability/apm/service_overview/instances_detailed_statistics.spec.ts
Outdated
Show resolved
Hide resolved
...gration/deployment_agnostic/apis/observability/apm/service_overview/instance_details.spec.ts
Show resolved
Hide resolved
...yment_agnostic/apis/observability/apm/service_overview/instances_detailed_statistics.spec.ts
Outdated
Show resolved
Hide resolved
...api_integration/tests/service_overview/__snapshots__/instances_detailed_statistics.spec.snap
Outdated
Show resolved
Hide resolved
|
/ci |
|
@elasticmachine merge upstream |
💛 Build succeeded, but was flaky
Failed CI StepsMetrics [docs]Unknown metric groupsESLint disabled line counts
Total ESLint disabled count
History
|
dmlemeshko
approved these changes
Nov 20, 2024
Flaky Test Runner Stats🎉 All tests passed! - kibana-flaky-test-suite-runner#7436[✅] x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts: 15/15 tests passed. |
|
Starting backport for target branches: 8.x |
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Nov 20, 2024
…ic approach (elastic#200226) ## Summary Part of elastic#193245 Closes elastic#198986 This PR moves all compatible/supported test cases for Service Overview. Unsupported cases are kept in the old test section to run on stateful for now. ## How to Test ### Serverless ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep="APM API tests" ``` It's recommended to be run against [MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki) ### Stateful ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="APM API tests" ``` --------- Co-authored-by: kibanamachine <[email protected]> Co-authored-by: Elastic Machine <[email protected]> (cherry picked from commit 185fa2a)
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
kibanamachine
added a commit
that referenced
this pull request
Nov 20, 2024
…agnostic approach (#200226) (#200916) # Backport This will backport the following commits from `main` to `8.x`: - [[ObsUX][APM] Migration of Service Overview tests to deployment agnostic approach (#200226)](#200226) <!--- Backport version: 9.4.3 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sqren/backport) <!--BACKPORT [{"author":{"name":"Gonçalo Rica Pais da Silva","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-11-20T13:17:24Z","message":"[ObsUX][APM] Migration of Service Overview tests to deployment agnostic approach (#200226)\n\n## Summary\r\n\r\nPart of #193245\r\nCloses #198986\r\n\r\nThis PR moves all compatible/supported test cases for Service Overview.\r\nUnsupported cases are kept in the old test section to run on stateful\r\nfor now.\r\n\r\n## How to Test\r\n\r\n### Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep=\"APM API tests\"\r\n```\r\n\r\nIt's recommended to be run against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n### Stateful\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep=\"APM API tests\"\r\n```\r\n\r\n---------\r\n\r\nCo-authored-by: kibanamachine <[email protected]>\r\nCo-authored-by: Elastic Machine <[email protected]>","sha":"185fa2a7dc086a0b30925ea4447f9ec3de1c8651","branchLabelMapping":{"^v9.0.0$":"main","^v8.17.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","backport:prev-minor","ci:project-deploy-observability","Team:obs-ux-infra_services","v8.17.0"],"title":"[ObsUX][APM] Migration of Service Overview tests to deployment agnostic approach","number":200226,"url":"https://github.com/elastic/kibana/pull/200226","mergeCommit":{"message":"[ObsUX][APM] Migration of Service Overview tests to deployment agnostic approach (#200226)\n\n## Summary\r\n\r\nPart of #193245\r\nCloses #198986\r\n\r\nThis PR moves all compatible/supported test cases for Service Overview.\r\nUnsupported cases are kept in the old test section to run on stateful\r\nfor now.\r\n\r\n## How to Test\r\n\r\n### Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep=\"APM API tests\"\r\n```\r\n\r\nIt's recommended to be run against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n### Stateful\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep=\"APM API tests\"\r\n```\r\n\r\n---------\r\n\r\nCo-authored-by: kibanamachine <[email protected]>\r\nCo-authored-by: Elastic Machine <[email protected]>","sha":"185fa2a7dc086a0b30925ea4447f9ec3de1c8651"}},"sourceBranch":"main","suggestedTargetBranches":["8.x"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/200226","number":200226,"mergeCommit":{"message":"[ObsUX][APM] Migration of Service Overview tests to deployment agnostic approach (#200226)\n\n## Summary\r\n\r\nPart of #193245\r\nCloses #198986\r\n\r\nThis PR moves all compatible/supported test cases for Service Overview.\r\nUnsupported cases are kept in the old test section to run on stateful\r\nfor now.\r\n\r\n## How to Test\r\n\r\n### Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep=\"APM API tests\"\r\n```\r\n\r\nIt's recommended to be run against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n### Stateful\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep=\"APM API tests\"\r\n```\r\n\r\n---------\r\n\r\nCo-authored-by: kibanamachine <[email protected]>\r\nCo-authored-by: Elastic Machine <[email protected]>","sha":"185fa2a7dc086a0b30925ea4447f9ec3de1c8651"}},{"branch":"8.x","label":"v8.17.0","branchLabelMappingKey":"^v8.17.0$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: Gonçalo Rica Pais da Silva <[email protected]>
Bluefinger
added a commit
that referenced
this pull request
Nov 25, 2024
…ce (#201407) Part of #193245 Related #200226 Closes #200743 ## Summary This PR completes the migration of remaining Service Overview tests to the Deployment Agnostic test framework. In this PR, one test was deduplicated (the Dependencies test), and the Instances Detailed Statistics cases dealing with archiver data was migrated to make use of synthtrace instead. Snapshots included were redone to match the data generated by synthtrace, but no other cases were changed to ensure the new migrated tests were passing the same assumptions as before. ## How to Test ### Serverless ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt/apm.serverless.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.apm.serverless.config.ts ``` It's recommended to be run against [MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki) ### Stateful ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts ``` --------- Co-authored-by: jennypavlova <[email protected]> Co-authored-by: Elastic Machine <[email protected]>
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Nov 25, 2024
…ce (elastic#201407) Part of elastic#193245 Related elastic#200226 Closes elastic#200743 ## Summary This PR completes the migration of remaining Service Overview tests to the Deployment Agnostic test framework. In this PR, one test was deduplicated (the Dependencies test), and the Instances Detailed Statistics cases dealing with archiver data was migrated to make use of synthtrace instead. Snapshots included were redone to match the data generated by synthtrace, but no other cases were changed to ensure the new migrated tests were passing the same assumptions as before. ## How to Test ### Serverless ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt/apm.serverless.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.apm.serverless.config.ts ``` It's recommended to be run against [MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki) ### Stateful ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts ``` --------- Co-authored-by: jennypavlova <[email protected]> Co-authored-by: Elastic Machine <[email protected]> (cherry picked from commit 4891c7d)
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Nov 25, 2024
…ce (elastic#201407) Part of elastic#193245 Related elastic#200226 Closes elastic#200743 ## Summary This PR completes the migration of remaining Service Overview tests to the Deployment Agnostic test framework. In this PR, one test was deduplicated (the Dependencies test), and the Instances Detailed Statistics cases dealing with archiver data was migrated to make use of synthtrace instead. Snapshots included were redone to match the data generated by synthtrace, but no other cases were changed to ensure the new migrated tests were passing the same assumptions as before. ## How to Test ### Serverless ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt/apm.serverless.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.apm.serverless.config.ts ``` It's recommended to be run against [MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki) ### Stateful ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts ``` --------- Co-authored-by: jennypavlova <[email protected]> Co-authored-by: Elastic Machine <[email protected]> (cherry picked from commit 4891c7d)
paulinashakirova
pushed a commit
to paulinashakirova/kibana
that referenced
this pull request
Nov 26, 2024
…ic approach (elastic#200226) ## Summary Part of elastic#193245 Closes elastic#198986 This PR moves all compatible/supported test cases for Service Overview. Unsupported cases are kept in the old test section to run on stateful for now. ## How to Test ### Serverless ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep="APM API tests" ``` It's recommended to be run against [MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki) ### Stateful ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="APM API tests" ``` --------- Co-authored-by: kibanamachine <[email protected]> Co-authored-by: Elastic Machine <[email protected]>
paulinashakirova
pushed a commit
to paulinashakirova/kibana
that referenced
this pull request
Nov 26, 2024
…ce (elastic#201407) Part of elastic#193245 Related elastic#200226 Closes elastic#200743 ## Summary This PR completes the migration of remaining Service Overview tests to the Deployment Agnostic test framework. In this PR, one test was deduplicated (the Dependencies test), and the Instances Detailed Statistics cases dealing with archiver data was migrated to make use of synthtrace instead. Snapshots included were redone to match the data generated by synthtrace, but no other cases were changed to ensure the new migrated tests were passing the same assumptions as before. ## How to Test ### Serverless ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt/apm.serverless.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.apm.serverless.config.ts ``` It's recommended to be run against [MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki) ### Stateful ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts ``` --------- Co-authored-by: jennypavlova <[email protected]> Co-authored-by: Elastic Machine <[email protected]>
kibanamachine
added a commit
that referenced
this pull request
Dec 9, 2024
…nthtrace (#201407) (#201537) # Backport This will backport the following commits from `main` to `8.x`: - [[ObsUX][APM] Migrate Service Overview archiver test cases to synthtrace (#201407)](#201407) <!--- Backport version: 9.4.3 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sqren/backport) <!--BACKPORT [{"author":{"name":"Gonçalo Rica Pais da Silva","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-11-25T10:13:16Z","message":"[ObsUX][APM] Migrate Service Overview archiver test cases to synthtrace (#201407)\n\nPart of #193245\r\nRelated #200226\r\nCloses #200743 \r\n\r\n## Summary\r\n\r\nThis PR completes the migration of remaining Service Overview tests to\r\nthe Deployment Agnostic test framework. In this PR, one test was\r\ndeduplicated (the Dependencies test), and the Instances Detailed\r\nStatistics cases dealing with archiver data was migrated to make use of\r\nsynthtrace instead. Snapshots included were redone to match the data\r\ngenerated by synthtrace, but no other cases were changed to ensure the\r\nnew migrated tests were passing the same assumptions as before.\r\n\r\n## How to Test\r\n\r\n### Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt/apm.serverless.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.apm.serverless.config.ts\r\n```\r\n\r\nIt's recommended to be run against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n### Stateful\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\r\n```\r\n\r\n---------\r\n\r\nCo-authored-by: jennypavlova <[email protected]>\r\nCo-authored-by: Elastic Machine <[email protected]>","sha":"4891c7d7f99097de649667ad0c1f48515120edbd","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","backport:prev-minor","ci:project-deploy-observability","Team:obs-ux-infra_services","v8.17.0"],"title":"[ObsUX][APM] Migrate Service Overview archiver test cases to synthtrace","number":201407,"url":"https://github.com/elastic/kibana/pull/201407","mergeCommit":{"message":"[ObsUX][APM] Migrate Service Overview archiver test cases to synthtrace (#201407)\n\nPart of #193245\r\nRelated #200226\r\nCloses #200743 \r\n\r\n## Summary\r\n\r\nThis PR completes the migration of remaining Service Overview tests to\r\nthe Deployment Agnostic test framework. In this PR, one test was\r\ndeduplicated (the Dependencies test), and the Instances Detailed\r\nStatistics cases dealing with archiver data was migrated to make use of\r\nsynthtrace instead. Snapshots included were redone to match the data\r\ngenerated by synthtrace, but no other cases were changed to ensure the\r\nnew migrated tests were passing the same assumptions as before.\r\n\r\n## How to Test\r\n\r\n### Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt/apm.serverless.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.apm.serverless.config.ts\r\n```\r\n\r\nIt's recommended to be run against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n### Stateful\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\r\n```\r\n\r\n---------\r\n\r\nCo-authored-by: jennypavlova <[email protected]>\r\nCo-authored-by: Elastic Machine <[email protected]>","sha":"4891c7d7f99097de649667ad0c1f48515120edbd"}},"sourceBranch":"main","suggestedTargetBranches":["8.17"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/201407","number":201407,"mergeCommit":{"message":"[ObsUX][APM] Migrate Service Overview archiver test cases to synthtrace (#201407)\n\nPart of #193245\r\nRelated #200226\r\nCloses #200743 \r\n\r\n## Summary\r\n\r\nThis PR completes the migration of remaining Service Overview tests to\r\nthe Deployment Agnostic test framework. In this PR, one test was\r\ndeduplicated (the Dependencies test), and the Instances Detailed\r\nStatistics cases dealing with archiver data was migrated to make use of\r\nsynthtrace instead. Snapshots included were redone to match the data\r\ngenerated by synthtrace, but no other cases were changed to ensure the\r\nnew migrated tests were passing the same assumptions as before.\r\n\r\n## How to Test\r\n\r\n### Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt/apm.serverless.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.apm.serverless.config.ts\r\n```\r\n\r\nIt's recommended to be run against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n### Stateful\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\r\n```\r\n\r\n---------\r\n\r\nCo-authored-by: jennypavlova <[email protected]>\r\nCo-authored-by: Elastic Machine <[email protected]>","sha":"4891c7d7f99097de649667ad0c1f48515120edbd"}},{"branch":"8.17","label":"v8.17.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: Gonçalo Rica Pais da Silva <[email protected]>
kibanamachine
added a commit
that referenced
this pull request
Dec 11, 2024
…ynthtrace (#201407) (#201536) # Backport This will backport the following commits from `main` to `8.17`: - [[ObsUX][APM] Migrate Service Overview archiver test cases to synthtrace (#201407)](#201407) <!--- Backport version: 9.4.3 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sqren/backport) <!--BACKPORT [{"author":{"name":"Gonçalo Rica Pais da Silva","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-11-25T10:13:16Z","message":"[ObsUX][APM] Migrate Service Overview archiver test cases to synthtrace (#201407)\n\nPart of #193245\r\nRelated #200226\r\nCloses #200743 \r\n\r\n## Summary\r\n\r\nThis PR completes the migration of remaining Service Overview tests to\r\nthe Deployment Agnostic test framework. In this PR, one test was\r\ndeduplicated (the Dependencies test), and the Instances Detailed\r\nStatistics cases dealing with archiver data was migrated to make use of\r\nsynthtrace instead. Snapshots included were redone to match the data\r\ngenerated by synthtrace, but no other cases were changed to ensure the\r\nnew migrated tests were passing the same assumptions as before.\r\n\r\n## How to Test\r\n\r\n### Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt/apm.serverless.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.apm.serverless.config.ts\r\n```\r\n\r\nIt's recommended to be run against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n### Stateful\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\r\n```\r\n\r\n---------\r\n\r\nCo-authored-by: jennypavlova <[email protected]>\r\nCo-authored-by: Elastic Machine <[email protected]>","sha":"4891c7d7f99097de649667ad0c1f48515120edbd","branchLabelMapping":{"^v9.0.0$":"main","^v8.18.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","backport:prev-minor","ci:project-deploy-observability","Team:obs-ux-infra_services","v8.17.0"],"title":"[ObsUX][APM] Migrate Service Overview archiver test cases to synthtrace","number":201407,"url":"https://github.com/elastic/kibana/pull/201407","mergeCommit":{"message":"[ObsUX][APM] Migrate Service Overview archiver test cases to synthtrace (#201407)\n\nPart of #193245\r\nRelated #200226\r\nCloses #200743 \r\n\r\n## Summary\r\n\r\nThis PR completes the migration of remaining Service Overview tests to\r\nthe Deployment Agnostic test framework. In this PR, one test was\r\ndeduplicated (the Dependencies test), and the Instances Detailed\r\nStatistics cases dealing with archiver data was migrated to make use of\r\nsynthtrace instead. Snapshots included were redone to match the data\r\ngenerated by synthtrace, but no other cases were changed to ensure the\r\nnew migrated tests were passing the same assumptions as before.\r\n\r\n## How to Test\r\n\r\n### Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt/apm.serverless.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.apm.serverless.config.ts\r\n```\r\n\r\nIt's recommended to be run against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n### Stateful\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\r\n```\r\n\r\n---------\r\n\r\nCo-authored-by: jennypavlova <[email protected]>\r\nCo-authored-by: Elastic Machine <[email protected]>","sha":"4891c7d7f99097de649667ad0c1f48515120edbd"}},"sourceBranch":"main","suggestedTargetBranches":["8.17"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/201407","number":201407,"mergeCommit":{"message":"[ObsUX][APM] Migrate Service Overview archiver test cases to synthtrace (#201407)\n\nPart of #193245\r\nRelated #200226\r\nCloses #200743 \r\n\r\n## Summary\r\n\r\nThis PR completes the migration of remaining Service Overview tests to\r\nthe Deployment Agnostic test framework. In this PR, one test was\r\ndeduplicated (the Dependencies test), and the Instances Detailed\r\nStatistics cases dealing with archiver data was migrated to make use of\r\nsynthtrace instead. Snapshots included were redone to match the data\r\ngenerated by synthtrace, but no other cases were changed to ensure the\r\nnew migrated tests were passing the same assumptions as before.\r\n\r\n## How to Test\r\n\r\n### Serverless\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt/apm.serverless.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.apm.serverless.config.ts\r\n```\r\n\r\nIt's recommended to be run against\r\n[MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki)\r\n\r\n### Stateful\r\n\r\n```\r\nnode scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\r\nnode scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts\r\n```\r\n\r\n---------\r\n\r\nCo-authored-by: jennypavlova <[email protected]>\r\nCo-authored-by: Elastic Machine <[email protected]>","sha":"4891c7d7f99097de649667ad0c1f48515120edbd"}},{"branch":"8.17","label":"v8.17.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: Gonçalo Rica Pais da Silva <[email protected]>
CAWilson94
pushed a commit
to CAWilson94/kibana
that referenced
this pull request
Dec 12, 2024
…ic approach (elastic#200226) ## Summary Part of elastic#193245 Closes elastic#198986 This PR moves all compatible/supported test cases for Service Overview. Unsupported cases are kept in the old test section to run on stateful for now. ## How to Test ### Serverless ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --grep="APM API tests" ``` It's recommended to be run against [MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki) ### Stateful ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.stateful.config.ts --grep="APM API tests" ``` --------- Co-authored-by: kibanamachine <[email protected]> Co-authored-by: Elastic Machine <[email protected]>
CAWilson94
pushed a commit
to CAWilson94/kibana
that referenced
this pull request
Dec 12, 2024
…ce (elastic#201407) Part of elastic#193245 Related elastic#200226 Closes elastic#200743 ## Summary This PR completes the migration of remaining Service Overview tests to the Deployment Agnostic test framework. In this PR, one test was deduplicated (the Dependencies test), and the Instances Detailed Statistics cases dealing with archiver data was migrated to make use of synthtrace instead. Snapshots included were redone to match the data generated by synthtrace, but no other cases were changed to ensure the new migrated tests were passing the same assumptions as before. ## How to Test ### Serverless ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt/apm.serverless.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.apm.serverless.config.ts ``` It's recommended to be run against [MKI](https://github.com/crespocarlos/kibana/blob/main/x-pack/test_serverless/README.md#run-tests-on-mki) ### Stateful ``` node scripts/functional_tests_server --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts node scripts/functional_test_runner --config x-pack/test/api_integration/deployment_agnostic/configs/stateful/oblt.apm.stateful.config.ts ``` --------- Co-authored-by: jennypavlova <[email protected]> Co-authored-by: Elastic Machine <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Part of #193245
Closes #198986
This PR moves all compatible/supported test cases for Service Overview. Unsupported cases are kept in the old test section to run on stateful for now.
How to Test
Serverless
It's recommended to be run against MKI
Stateful