[Security Solution][Detection Engine] fixes ES|QL data tier filter from adv settings #196390
+70
−1
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
vitaliidm
added
release_note:skip
|
Pinging @elastic/security-detections-response (Team:Detections and Resp) |
|
Pinging @elastic/security-solution (Team: SecuritySolution) |
|
Pinging @elastic/security-detection-engine (Team:Detection Engine) |
💚 Build Succeeded
Metrics [docs]
History
cc @vitaliidm |
dhurley14
approved these changes
Oct 17, 2024
|
Starting backport for target branches: 8.16, 8.x |
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Oct 17, 2024
…om adv settings (elastic#196390) ## Summary - fixes absent data tier filter for ES|QL rule - followup to elastic#186908 ### Demo https://github.com/user-attachments/assets/a6f1290f-ea77-43bf-8def-42712ca5d1b0 ### How to test Create a deployment with cold and frozen data tiers and use following commands to create index and ILM <details> <summary>Data tiers commands</summary> ```JSON PUT /_cluster/settings { "persistent": { "indices.lifecycle.poll_interval": "1m" } } PUT /_ilm/policy/filtering_data_tiers { "policy": { "phases": { "frozen": { "min_age": "10m", "actions": { "searchable_snapshot": { "snapshot_repository": "found-snapshots", "force_merge_index": true } } }, "cold": { "min_age": "1m", "actions": { "searchable_snapshot": { "snapshot_repository": "found-snapshots", "force_merge_index": true }, "set_priority": { "priority": 0 } } }, "hot": { "min_age": "0ms", "actions": { "set_priority": { "priority": 100 } } } } } } PUT /_index_template/filtering_data_tiers_template { "index_patterns": [ "filtering_data_tiers*" ], "template": { "settings": { "index.lifecycle.name": "filtering_data_tiers", "index.lifecycle.rollover_alias": "test-filtering_data_tiers" }, "mappings": { "_meta": { "version": "1.6.0" }, "properties": { "@timestamp": { "type": "date" }, "host": { "properties": { "name": { "type": "keyword", "ignore_above": 1024 } } } } } } } PUT /filtering_data_tiers-000001 { "aliases": { "filtering_data_tiers": { "is_write_index": true } } } POST filtering_data_tiers/_doc { "@timestamp": "2024-07-08T17:00:01.000Z", "host.name": "test-0" } ``` </details> (cherry picked from commit c79f0ae)
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Oct 17, 2024
…om adv settings (elastic#196390) ## Summary - fixes absent data tier filter for ES|QL rule - followup to elastic#186908 ### Demo https://github.com/user-attachments/assets/a6f1290f-ea77-43bf-8def-42712ca5d1b0 ### How to test Create a deployment with cold and frozen data tiers and use following commands to create index and ILM <details> <summary>Data tiers commands</summary> ```JSON PUT /_cluster/settings { "persistent": { "indices.lifecycle.poll_interval": "1m" } } PUT /_ilm/policy/filtering_data_tiers { "policy": { "phases": { "frozen": { "min_age": "10m", "actions": { "searchable_snapshot": { "snapshot_repository": "found-snapshots", "force_merge_index": true } } }, "cold": { "min_age": "1m", "actions": { "searchable_snapshot": { "snapshot_repository": "found-snapshots", "force_merge_index": true }, "set_priority": { "priority": 0 } } }, "hot": { "min_age": "0ms", "actions": { "set_priority": { "priority": 100 } } } } } } PUT /_index_template/filtering_data_tiers_template { "index_patterns": [ "filtering_data_tiers*" ], "template": { "settings": { "index.lifecycle.name": "filtering_data_tiers", "index.lifecycle.rollover_alias": "test-filtering_data_tiers" }, "mappings": { "_meta": { "version": "1.6.0" }, "properties": { "@timestamp": { "type": "date" }, "host": { "properties": { "name": { "type": "keyword", "ignore_above": 1024 } } } } } } } PUT /filtering_data_tiers-000001 { "aliases": { "filtering_data_tiers": { "is_write_index": true } } } POST filtering_data_tiers/_doc { "@timestamp": "2024-07-08T17:00:01.000Z", "host.name": "test-0" } ``` </details> (cherry picked from commit c79f0ae)
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
kibanamachine
added a commit
that referenced
this pull request
Oct 17, 2024
…ter from adv settings (#196390) (#196699) # Backport This will backport the following commits from `main` to `8.x`: - [[Security Solution][Detection Engine] fixes ES|QL data tier filter from adv settings (#196390)](#196390) <!--- Backport version: 9.4.3 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sqren/backport) <!--BACKPORT [{"author":{"name":"Vitalii Dmyterko","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-10-17T13:28:14Z","message":"[Security Solution][Detection Engine] fixes ES|QL data tier filter from adv settings (#196390)\n\n## Summary\r\n\r\n- fixes absent data tier filter for ES|QL rule\r\n- followup to https://github.com/elastic/kibana/pull/186908\r\n\r\n### Demo\r\n\r\n\r\nhttps://github.com/user-attachments/assets/a6f1290f-ea77-43bf-8def-42712ca5d1b0\r\n\r\n\r\n\r\n### How to test\r\n\r\nCreate a deployment with cold and frozen data tiers and use following\r\ncommands to create index and ILM\r\n\r\n\r\n<details>\r\n<summary>Data tiers commands</summary>\r\n\r\n```JSON\r\n\r\nPUT /_cluster/settings\r\n{\r\n \"persistent\": {\r\n \"indices.lifecycle.poll_interval\": \"1m\"\r\n }\r\n}\r\n\r\n\r\nPUT /_ilm/policy/filtering_data_tiers\r\n{\r\n \"policy\": {\r\n \"phases\": {\r\n \"frozen\": {\r\n \"min_age\": \"10m\",\r\n \"actions\": {\r\n \"searchable_snapshot\": {\r\n \"snapshot_repository\": \"found-snapshots\",\r\n \"force_merge_index\": true\r\n }\r\n }\r\n },\r\n \"cold\": {\r\n \"min_age\": \"1m\",\r\n \"actions\": {\r\n \"searchable_snapshot\": {\r\n \"snapshot_repository\": \"found-snapshots\",\r\n \"force_merge_index\": true\r\n },\r\n \"set_priority\": {\r\n \"priority\": 0\r\n }\r\n }\r\n },\r\n \"hot\": {\r\n \"min_age\": \"0ms\",\r\n \"actions\": {\r\n \"set_priority\": {\r\n \"priority\": 100\r\n }\r\n }\r\n }\r\n }\r\n }\r\n}\r\n\r\n\r\nPUT /_index_template/filtering_data_tiers_template\r\n{\r\n \"index_patterns\": [\r\n \"filtering_data_tiers*\"\r\n ],\r\n \"template\": {\r\n \"settings\": {\r\n \"index.lifecycle.name\": \"filtering_data_tiers\",\r\n \"index.lifecycle.rollover_alias\": \"test-filtering_data_tiers\"\r\n },\r\n \"mappings\": {\r\n \"_meta\": {\r\n \"version\": \"1.6.0\"\r\n },\r\n \"properties\": {\r\n \"@timestamp\": {\r\n \"type\": \"date\"\r\n },\r\n \"host\": {\r\n \"properties\": {\r\n \"name\": {\r\n \"type\": \"keyword\",\r\n \"ignore_above\": 1024\r\n }\r\n }\r\n }\r\n }\r\n }\r\n }\r\n}\r\n\r\nPUT /filtering_data_tiers-000001\r\n{\r\n \"aliases\": {\r\n \"filtering_data_tiers\": {\r\n \"is_write_index\": true\r\n }\r\n }\r\n}\r\n\r\n\r\nPOST filtering_data_tiers/_doc\r\n{\r\n \"@timestamp\": \"2024-07-08T17:00:01.000Z\",\r\n \"host.name\": \"test-0\"\r\n}\r\n\r\n\r\n```\r\n\r\n</details>","sha":"c79f0ae78633c81beebd3f95735326cc872be7f6","branchLabelMapping":{"^v9.0.0$":"main","^v8.17.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","Team:Detections and Resp","Team: SecuritySolution","backport:prev-minor","Team:Detection Engine","v8.16.0"],"title":"[Security Solution][Detection Engine] fixes ES|QL data tier filter from adv settings","number":196390,"url":"https://github.com/elastic/kibana/pull/196390","mergeCommit":{"message":"[Security Solution][Detection Engine] fixes ES|QL data tier filter from adv settings (#196390)\n\n## Summary\r\n\r\n- fixes absent data tier filter for ES|QL rule\r\n- followup to https://github.com/elastic/kibana/pull/186908\r\n\r\n### Demo\r\n\r\n\r\nhttps://github.com/user-attachments/assets/a6f1290f-ea77-43bf-8def-42712ca5d1b0\r\n\r\n\r\n\r\n### How to test\r\n\r\nCreate a deployment with cold and frozen data tiers and use following\r\ncommands to create index and ILM\r\n\r\n\r\n<details>\r\n<summary>Data tiers commands</summary>\r\n\r\n```JSON\r\n\r\nPUT /_cluster/settings\r\n{\r\n \"persistent\": {\r\n \"indices.lifecycle.poll_interval\": \"1m\"\r\n }\r\n}\r\n\r\n\r\nPUT /_ilm/policy/filtering_data_tiers\r\n{\r\n \"policy\": {\r\n \"phases\": {\r\n \"frozen\": {\r\n \"min_age\": \"10m\",\r\n \"actions\": {\r\n \"searchable_snapshot\": {\r\n \"snapshot_repository\": \"found-snapshots\",\r\n \"force_merge_index\": true\r\n }\r\n }\r\n },\r\n \"cold\": {\r\n \"min_age\": \"1m\",\r\n \"actions\": {\r\n \"searchable_snapshot\": {\r\n \"snapshot_repository\": \"found-snapshots\",\r\n \"force_merge_index\": true\r\n },\r\n \"set_priority\": {\r\n \"priority\": 0\r\n }\r\n }\r\n },\r\n \"hot\": {\r\n \"min_age\": \"0ms\",\r\n \"actions\": {\r\n \"set_priority\": {\r\n \"priority\": 100\r\n }\r\n }\r\n }\r\n }\r\n }\r\n}\r\n\r\n\r\nPUT /_index_template/filtering_data_tiers_template\r\n{\r\n \"index_patterns\": [\r\n \"filtering_data_tiers*\"\r\n ],\r\n \"template\": {\r\n \"settings\": {\r\n \"index.lifecycle.name\": \"filtering_data_tiers\",\r\n \"index.lifecycle.rollover_alias\": \"test-filtering_data_tiers\"\r\n },\r\n \"mappings\": {\r\n \"_meta\": {\r\n \"version\": \"1.6.0\"\r\n },\r\n \"properties\": {\r\n \"@timestamp\": {\r\n \"type\": \"date\"\r\n },\r\n \"host\": {\r\n \"properties\": {\r\n \"name\": {\r\n \"type\": \"keyword\",\r\n \"ignore_above\": 1024\r\n }\r\n }\r\n }\r\n }\r\n }\r\n }\r\n}\r\n\r\nPUT /filtering_data_tiers-000001\r\n{\r\n \"aliases\": {\r\n \"filtering_data_tiers\": {\r\n \"is_write_index\": true\r\n }\r\n }\r\n}\r\n\r\n\r\nPOST filtering_data_tiers/_doc\r\n{\r\n \"@timestamp\": \"2024-07-08T17:00:01.000Z\",\r\n \"host.name\": \"test-0\"\r\n}\r\n\r\n\r\n```\r\n\r\n</details>","sha":"c79f0ae78633c81beebd3f95735326cc872be7f6"}},"sourceBranch":"main","suggestedTargetBranches":["8.16"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/196390","number":196390,"mergeCommit":{"message":"[Security Solution][Detection Engine] fixes ES|QL data tier filter from adv settings (#196390)\n\n## Summary\r\n\r\n- fixes absent data tier filter for ES|QL rule\r\n- followup to https://github.com/elastic/kibana/pull/186908\r\n\r\n### Demo\r\n\r\n\r\nhttps://github.com/user-attachments/assets/a6f1290f-ea77-43bf-8def-42712ca5d1b0\r\n\r\n\r\n\r\n### How to test\r\n\r\nCreate a deployment with cold and frozen data tiers and use following\r\ncommands to create index and ILM\r\n\r\n\r\n<details>\r\n<summary>Data tiers commands</summary>\r\n\r\n```JSON\r\n\r\nPUT /_cluster/settings\r\n{\r\n \"persistent\": {\r\n \"indices.lifecycle.poll_interval\": \"1m\"\r\n }\r\n}\r\n\r\n\r\nPUT /_ilm/policy/filtering_data_tiers\r\n{\r\n \"policy\": {\r\n \"phases\": {\r\n \"frozen\": {\r\n \"min_age\": \"10m\",\r\n \"actions\": {\r\n \"searchable_snapshot\": {\r\n \"snapshot_repository\": \"found-snapshots\",\r\n \"force_merge_index\": true\r\n }\r\n }\r\n },\r\n \"cold\": {\r\n \"min_age\": \"1m\",\r\n \"actions\": {\r\n \"searchable_snapshot\": {\r\n \"snapshot_repository\": \"found-snapshots\",\r\n \"force_merge_index\": true\r\n },\r\n \"set_priority\": {\r\n \"priority\": 0\r\n }\r\n }\r\n },\r\n \"hot\": {\r\n \"min_age\": \"0ms\",\r\n \"actions\": {\r\n \"set_priority\": {\r\n \"priority\": 100\r\n }\r\n }\r\n }\r\n }\r\n }\r\n}\r\n\r\n\r\nPUT /_index_template/filtering_data_tiers_template\r\n{\r\n \"index_patterns\": [\r\n \"filtering_data_tiers*\"\r\n ],\r\n \"template\": {\r\n \"settings\": {\r\n \"index.lifecycle.name\": \"filtering_data_tiers\",\r\n \"index.lifecycle.rollover_alias\": \"test-filtering_data_tiers\"\r\n },\r\n \"mappings\": {\r\n \"_meta\": {\r\n \"version\": \"1.6.0\"\r\n },\r\n \"properties\": {\r\n \"@timestamp\": {\r\n \"type\": \"date\"\r\n },\r\n \"host\": {\r\n \"properties\": {\r\n \"name\": {\r\n \"type\": \"keyword\",\r\n \"ignore_above\": 1024\r\n }\r\n }\r\n }\r\n }\r\n }\r\n }\r\n}\r\n\r\nPUT /filtering_data_tiers-000001\r\n{\r\n \"aliases\": {\r\n \"filtering_data_tiers\": {\r\n \"is_write_index\": true\r\n }\r\n }\r\n}\r\n\r\n\r\nPOST filtering_data_tiers/_doc\r\n{\r\n \"@timestamp\": \"2024-07-08T17:00:01.000Z\",\r\n \"host.name\": \"test-0\"\r\n}\r\n\r\n\r\n```\r\n\r\n</details>","sha":"c79f0ae78633c81beebd3f95735326cc872be7f6"}},{"branch":"8.16","label":"v8.16.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: Vitalii Dmyterko <[email protected]>
kibanamachine
added a commit
that referenced
this pull request
Oct 17, 2024
…lter from adv settings (#196390) (#196698) # Backport This will backport the following commits from `main` to `8.16`: - [[Security Solution][Detection Engine] fixes ES|QL data tier filter from adv settings (#196390)](#196390) <!--- Backport version: 9.4.3 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sqren/backport) <!--BACKPORT [{"author":{"name":"Vitalii Dmyterko","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-10-17T13:28:14Z","message":"[Security Solution][Detection Engine] fixes ES|QL data tier filter from adv settings (#196390)\n\n## Summary\r\n\r\n- fixes absent data tier filter for ES|QL rule\r\n- followup to https://github.com/elastic/kibana/pull/186908\r\n\r\n### Demo\r\n\r\n\r\nhttps://github.com/user-attachments/assets/a6f1290f-ea77-43bf-8def-42712ca5d1b0\r\n\r\n\r\n\r\n### How to test\r\n\r\nCreate a deployment with cold and frozen data tiers and use following\r\ncommands to create index and ILM\r\n\r\n\r\n<details>\r\n<summary>Data tiers commands</summary>\r\n\r\n```JSON\r\n\r\nPUT /_cluster/settings\r\n{\r\n \"persistent\": {\r\n \"indices.lifecycle.poll_interval\": \"1m\"\r\n }\r\n}\r\n\r\n\r\nPUT /_ilm/policy/filtering_data_tiers\r\n{\r\n \"policy\": {\r\n \"phases\": {\r\n \"frozen\": {\r\n \"min_age\": \"10m\",\r\n \"actions\": {\r\n \"searchable_snapshot\": {\r\n \"snapshot_repository\": \"found-snapshots\",\r\n \"force_merge_index\": true\r\n }\r\n }\r\n },\r\n \"cold\": {\r\n \"min_age\": \"1m\",\r\n \"actions\": {\r\n \"searchable_snapshot\": {\r\n \"snapshot_repository\": \"found-snapshots\",\r\n \"force_merge_index\": true\r\n },\r\n \"set_priority\": {\r\n \"priority\": 0\r\n }\r\n }\r\n },\r\n \"hot\": {\r\n \"min_age\": \"0ms\",\r\n \"actions\": {\r\n \"set_priority\": {\r\n \"priority\": 100\r\n }\r\n }\r\n }\r\n }\r\n }\r\n}\r\n\r\n\r\nPUT /_index_template/filtering_data_tiers_template\r\n{\r\n \"index_patterns\": [\r\n \"filtering_data_tiers*\"\r\n ],\r\n \"template\": {\r\n \"settings\": {\r\n \"index.lifecycle.name\": \"filtering_data_tiers\",\r\n \"index.lifecycle.rollover_alias\": \"test-filtering_data_tiers\"\r\n },\r\n \"mappings\": {\r\n \"_meta\": {\r\n \"version\": \"1.6.0\"\r\n },\r\n \"properties\": {\r\n \"@timestamp\": {\r\n \"type\": \"date\"\r\n },\r\n \"host\": {\r\n \"properties\": {\r\n \"name\": {\r\n \"type\": \"keyword\",\r\n \"ignore_above\": 1024\r\n }\r\n }\r\n }\r\n }\r\n }\r\n }\r\n}\r\n\r\nPUT /filtering_data_tiers-000001\r\n{\r\n \"aliases\": {\r\n \"filtering_data_tiers\": {\r\n \"is_write_index\": true\r\n }\r\n }\r\n}\r\n\r\n\r\nPOST filtering_data_tiers/_doc\r\n{\r\n \"@timestamp\": \"2024-07-08T17:00:01.000Z\",\r\n \"host.name\": \"test-0\"\r\n}\r\n\r\n\r\n```\r\n\r\n</details>","sha":"c79f0ae78633c81beebd3f95735326cc872be7f6","branchLabelMapping":{"^v9.0.0$":"main","^v8.17.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","Team:Detections and Resp","Team: SecuritySolution","backport:prev-minor","Team:Detection Engine","v8.16.0"],"title":"[Security Solution][Detection Engine] fixes ES|QL data tier filter from adv settings","number":196390,"url":"https://github.com/elastic/kibana/pull/196390","mergeCommit":{"message":"[Security Solution][Detection Engine] fixes ES|QL data tier filter from adv settings (#196390)\n\n## Summary\r\n\r\n- fixes absent data tier filter for ES|QL rule\r\n- followup to https://github.com/elastic/kibana/pull/186908\r\n\r\n### Demo\r\n\r\n\r\nhttps://github.com/user-attachments/assets/a6f1290f-ea77-43bf-8def-42712ca5d1b0\r\n\r\n\r\n\r\n### How to test\r\n\r\nCreate a deployment with cold and frozen data tiers and use following\r\ncommands to create index and ILM\r\n\r\n\r\n<details>\r\n<summary>Data tiers commands</summary>\r\n\r\n```JSON\r\n\r\nPUT /_cluster/settings\r\n{\r\n \"persistent\": {\r\n \"indices.lifecycle.poll_interval\": \"1m\"\r\n }\r\n}\r\n\r\n\r\nPUT /_ilm/policy/filtering_data_tiers\r\n{\r\n \"policy\": {\r\n \"phases\": {\r\n \"frozen\": {\r\n \"min_age\": \"10m\",\r\n \"actions\": {\r\n \"searchable_snapshot\": {\r\n \"snapshot_repository\": \"found-snapshots\",\r\n \"force_merge_index\": true\r\n }\r\n }\r\n },\r\n \"cold\": {\r\n \"min_age\": \"1m\",\r\n \"actions\": {\r\n \"searchable_snapshot\": {\r\n \"snapshot_repository\": \"found-snapshots\",\r\n \"force_merge_index\": true\r\n },\r\n \"set_priority\": {\r\n \"priority\": 0\r\n }\r\n }\r\n },\r\n \"hot\": {\r\n \"min_age\": \"0ms\",\r\n \"actions\": {\r\n \"set_priority\": {\r\n \"priority\": 100\r\n }\r\n }\r\n }\r\n }\r\n }\r\n}\r\n\r\n\r\nPUT /_index_template/filtering_data_tiers_template\r\n{\r\n \"index_patterns\": [\r\n \"filtering_data_tiers*\"\r\n ],\r\n \"template\": {\r\n \"settings\": {\r\n \"index.lifecycle.name\": \"filtering_data_tiers\",\r\n \"index.lifecycle.rollover_alias\": \"test-filtering_data_tiers\"\r\n },\r\n \"mappings\": {\r\n \"_meta\": {\r\n \"version\": \"1.6.0\"\r\n },\r\n \"properties\": {\r\n \"@timestamp\": {\r\n \"type\": \"date\"\r\n },\r\n \"host\": {\r\n \"properties\": {\r\n \"name\": {\r\n \"type\": \"keyword\",\r\n \"ignore_above\": 1024\r\n }\r\n }\r\n }\r\n }\r\n }\r\n }\r\n}\r\n\r\nPUT /filtering_data_tiers-000001\r\n{\r\n \"aliases\": {\r\n \"filtering_data_tiers\": {\r\n \"is_write_index\": true\r\n }\r\n }\r\n}\r\n\r\n\r\nPOST filtering_data_tiers/_doc\r\n{\r\n \"@timestamp\": \"2024-07-08T17:00:01.000Z\",\r\n \"host.name\": \"test-0\"\r\n}\r\n\r\n\r\n```\r\n\r\n</details>","sha":"c79f0ae78633c81beebd3f95735326cc872be7f6"}},"sourceBranch":"main","suggestedTargetBranches":["8.16"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/196390","number":196390,"mergeCommit":{"message":"[Security Solution][Detection Engine] fixes ES|QL data tier filter from adv settings (#196390)\n\n## Summary\r\n\r\n- fixes absent data tier filter for ES|QL rule\r\n- followup to https://github.com/elastic/kibana/pull/186908\r\n\r\n### Demo\r\n\r\n\r\nhttps://github.com/user-attachments/assets/a6f1290f-ea77-43bf-8def-42712ca5d1b0\r\n\r\n\r\n\r\n### How to test\r\n\r\nCreate a deployment with cold and frozen data tiers and use following\r\ncommands to create index and ILM\r\n\r\n\r\n<details>\r\n<summary>Data tiers commands</summary>\r\n\r\n```JSON\r\n\r\nPUT /_cluster/settings\r\n{\r\n \"persistent\": {\r\n \"indices.lifecycle.poll_interval\": \"1m\"\r\n }\r\n}\r\n\r\n\r\nPUT /_ilm/policy/filtering_data_tiers\r\n{\r\n \"policy\": {\r\n \"phases\": {\r\n \"frozen\": {\r\n \"min_age\": \"10m\",\r\n \"actions\": {\r\n \"searchable_snapshot\": {\r\n \"snapshot_repository\": \"found-snapshots\",\r\n \"force_merge_index\": true\r\n }\r\n }\r\n },\r\n \"cold\": {\r\n \"min_age\": \"1m\",\r\n \"actions\": {\r\n \"searchable_snapshot\": {\r\n \"snapshot_repository\": \"found-snapshots\",\r\n \"force_merge_index\": true\r\n },\r\n \"set_priority\": {\r\n \"priority\": 0\r\n }\r\n }\r\n },\r\n \"hot\": {\r\n \"min_age\": \"0ms\",\r\n \"actions\": {\r\n \"set_priority\": {\r\n \"priority\": 100\r\n }\r\n }\r\n }\r\n }\r\n }\r\n}\r\n\r\n\r\nPUT /_index_template/filtering_data_tiers_template\r\n{\r\n \"index_patterns\": [\r\n \"filtering_data_tiers*\"\r\n ],\r\n \"template\": {\r\n \"settings\": {\r\n \"index.lifecycle.name\": \"filtering_data_tiers\",\r\n \"index.lifecycle.rollover_alias\": \"test-filtering_data_tiers\"\r\n },\r\n \"mappings\": {\r\n \"_meta\": {\r\n \"version\": \"1.6.0\"\r\n },\r\n \"properties\": {\r\n \"@timestamp\": {\r\n \"type\": \"date\"\r\n },\r\n \"host\": {\r\n \"properties\": {\r\n \"name\": {\r\n \"type\": \"keyword\",\r\n \"ignore_above\": 1024\r\n }\r\n }\r\n }\r\n }\r\n }\r\n }\r\n}\r\n\r\nPUT /filtering_data_tiers-000001\r\n{\r\n \"aliases\": {\r\n \"filtering_data_tiers\": {\r\n \"is_write_index\": true\r\n }\r\n }\r\n}\r\n\r\n\r\nPOST filtering_data_tiers/_doc\r\n{\r\n \"@timestamp\": \"2024-07-08T17:00:01.000Z\",\r\n \"host.name\": \"test-0\"\r\n}\r\n\r\n\r\n```\r\n\r\n</details>","sha":"c79f0ae78633c81beebd3f95735326cc872be7f6"}},{"branch":"8.16","label":"v8.16.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: Vitalii Dmyterko <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Demo
Screen.Recording.2024-10-15.at.18.04.43.mov
How to test
Create a deployment with cold and frozen data tiers and use following commands to create index and ILM
Data tiers commands