Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate updating just the kibana.* field mappings on existing alerts-as-data indices #170341

Open
mikecote opened this issue Nov 1, 2023 · 1 comment
Labels
Feature:Alerting research Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams)

Comments

@mikecote
Copy link
Contributor

mikecote commented Nov 1, 2023

Related to: #168959

Given we update existing alerts-as-data indices to mutable fields, it would be worth investigating if we should only update the mapping of those mutable fields (mainly kibana.*) to avoid having ECS (and other) mapping conflicts down the road.

To have the latest ECS mappings for the newly written alerts, we would have to consider one of the two options (or a combination of them):

  • Rollover the index after updating the mappings. This will cause a new index to be created with the latest mappings for newly written alerts. We'll need to think about scenarios where multiple Kibana instances triggering rollovers, or frequent upgrades causing rollovers.
  • Update the mappings of the current write index to have the latest mappings. Some failure / fallback scenarios will need to be thought of.

Note: If ever an ongoing alert is updated by the framework in an older index, we would be relying implicitly on the ignore_malformed capability to prevent errors updating those documents. If there's a way we can make this more explicit, great!

@mikecote mikecote added Feature:Alerting Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams) labels Nov 1, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/response-ops (Team:ResponseOps)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature:Alerting research Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams)
Projects
No open projects
Development

No branches or pull requests

2 participants