Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Dataset quality] Failure store support in synthtrace #195726

Merged
merged 4 commits into from
Oct 10, 2024

Conversation

yngrdyn
Copy link
Contributor

@yngrdyn yngrdyn commented Oct 10, 2024

This PR enables the creation of scenarios using failure store in synthtrace.

How to test?

  1. Run the scenario node scripts/synthtrace failed_logs
  2. Go to dev console
    • For getting documents ingested GET logs-*-*/_search. This is equivalent to GET logs-*-*/_search?failure_store=exclude and will only include the documents that were properly ingested.
    • For getting documents in failure store GET logs-*-*/_search?failure_store=only
Screen.Recording.2024-10-10.at.11.33.45.mov

@yngrdyn yngrdyn requested review from a team as code owners October 10, 2024 09:25
@botelastic botelastic bot added ci:project-deploy-observability Create an Observability project Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team labels Oct 10, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-infra_services-team (Team:obs-ux-infra_services)

@yngrdyn yngrdyn added release_note:skip Skip the PR/issue when compiling release notes backport:prev-minor Backport to (8.x) the previous minor version (i.e. one version back from main) labels Oct 10, 2024
Copy link
Contributor

@MiriamAparicio MiriamAparicio left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code review only
LGTM 🌟

Copy link
Contributor

@mohamedhamed-ahmed mohamedhamed-ahmed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!! Thanks for this great work 👏

@yngrdyn yngrdyn enabled auto-merge (squash) October 10, 2024 10:12
@yngrdyn yngrdyn self-assigned this Oct 10, 2024
@elasticmachine
Copy link
Contributor

elasticmachine commented Oct 10, 2024

💛 Build succeeded, but was flaky

  • Buildkite Build
  • Commit: 1b75ed3
  • Kibana Serverless Image: docker.elastic.co/kibana-ci/kibana-serverless:pr-195726-1b75ed3a6c4c

Failed CI Steps

Test Failures

  • [job] [logs] Jest Tests #2 / Header rendering it renders the data providers when show is true
  • [job] [logs] FTR Configs #55 / Machine Learning anomaly detectors POST anomaly_detectors _forecast with spaces should delete forecast for user with permissions

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id before after diff
@kbn/apm-synthtrace 59 64 +5
Unknown metric groups

API count

id before after diff
@kbn/apm-synthtrace 59 64 +5

History

cc @yngrdyn

@yngrdyn yngrdyn merged commit bf72e41 into elastic:main Oct 10, 2024
26 checks passed
@kibanamachine
Copy link
Contributor

Starting backport for target branches: 8.x

https://github.com/elastic/kibana/actions/runs/11275971106

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Oct 10, 2024
This PR enables the creation of scenarios using failure store in
synthtrace.

#### How to test?
1. Run the scenario `node scripts/synthtrace failed_logs`
2. Go to dev console
- For getting documents ingested `GET logs-*-*/_search`. This is
equivalent to `GET logs-*-*/_search?failure_store=exclude` and will only
include the documents that were properly ingested.
- For getting documents in failure store `GET
logs-*-*/_search?failure_store=only`

https://github.com/user-attachments/assets/5013a0af-fdfc-453a-b70c-fb2c452ad4d8
(cherry picked from commit bf72e41)
@kibanamachine
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.x

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Oct 10, 2024
…#195781)

# Backport

This will backport the following commits from `main` to `8.x`:
- [[Dataset quality] Failure store support in synthtrace
(#195726)](#195726)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Yngrid
Coello","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-10-10T14:19:52Z","message":"[Dataset
quality] Failure store support in synthtrace (#195726)\n\nThis PR
enables the creation of scenarios using failure store
in\r\nsynthtrace.\r\n\r\n#### How to test?\r\n1. Run the scenario `node
scripts/synthtrace failed_logs`\r\n2. Go to dev console\r\n- For getting
documents ingested `GET logs-*-*/_search`. This is\r\nequivalent to `GET
logs-*-*/_search?failure_store=exclude` and will only\r\ninclude the
documents that were properly ingested.\r\n- For getting documents in
failure store
`GET\r\nlogs-*-*/_search?failure_store=only`\r\n\r\n\r\nhttps://github.com/user-attachments/assets/5013a0af-fdfc-453a-b70c-fb2c452ad4d8","sha":"bf72e414206e7eafedb92b127df7f318604fc78e","branchLabelMapping":{"^v9.0.0$":"main","^v8.16.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","backport:prev-minor","ci:project-deploy-observability","Team:obs-ux-infra_services"],"title":"[Dataset
quality] Failure store support in
synthtrace","number":195726,"url":"https://github.com/elastic/kibana/pull/195726","mergeCommit":{"message":"[Dataset
quality] Failure store support in synthtrace (#195726)\n\nThis PR
enables the creation of scenarios using failure store
in\r\nsynthtrace.\r\n\r\n#### How to test?\r\n1. Run the scenario `node
scripts/synthtrace failed_logs`\r\n2. Go to dev console\r\n- For getting
documents ingested `GET logs-*-*/_search`. This is\r\nequivalent to `GET
logs-*-*/_search?failure_store=exclude` and will only\r\ninclude the
documents that were properly ingested.\r\n- For getting documents in
failure store
`GET\r\nlogs-*-*/_search?failure_store=only`\r\n\r\n\r\nhttps://github.com/user-attachments/assets/5013a0af-fdfc-453a-b70c-fb2c452ad4d8","sha":"bf72e414206e7eafedb92b127df7f318604fc78e"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/195726","number":195726,"mergeCommit":{"message":"[Dataset
quality] Failure store support in synthtrace (#195726)\n\nThis PR
enables the creation of scenarios using failure store
in\r\nsynthtrace.\r\n\r\n#### How to test?\r\n1. Run the scenario `node
scripts/synthtrace failed_logs`\r\n2. Go to dev console\r\n- For getting
documents ingested `GET logs-*-*/_search`. This is\r\nequivalent to `GET
logs-*-*/_search?failure_store=exclude` and will only\r\ninclude the
documents that were properly ingested.\r\n- For getting documents in
failure store
`GET\r\nlogs-*-*/_search?failure_store=only`\r\n\r\n\r\nhttps://github.com/user-attachments/assets/5013a0af-fdfc-453a-b70c-fb2c452ad4d8","sha":"bf72e414206e7eafedb92b127df7f318604fc78e"}}]}]
BACKPORT-->

Co-authored-by: Yngrid Coello <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
apm:review backport:prev-minor Backport to (8.x) the previous minor version (i.e. one version back from main) ci:project-deploy-observability Create an Observability project release_note:skip Skip the PR/issue when compiling release notes Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team v8.16.0 v9.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants