diff --git a/elastic/logs/README.md b/elastic/logs/README.md index b7aac8c27..d68b52bf9 100644 --- a/elastic/logs/README.md +++ b/elastic/logs/README.md @@ -220,6 +220,7 @@ The following parameters are available: * `corpora_uri_base` (default: `https://rally-tracks.elastic.co`) - Specify the base location of the datasets used by this track. * `lifecycle` (default: unset to fall back on Serverless detection) - Specifies the lifecycle management feature to use for data streams. Use `ilm` for index lifecycle management or `dlm` for data lifecycle management. By default, `dlm` will be used for benchmarking Serverless Elasticsearch. * `workflow-request-cache` (default: `true`) - Explicit control of request cache query parameter in searches executed in a workflow. This can be further overriden at an operation level with `request-cache` parameter. +* `synthetic_source_keep` (default: unset) - Allows overriding the default synthetic source behaviour for all field types with the following values: `none` (equivalent to unset) - no source is stored, `arrays` - source stored as is only for multi-value (array) fields. ### Data Download Parameters diff --git a/elastic/logs/templates/component/track-shared-logsdb-mode.json b/elastic/logs/templates/component/track-shared-logsdb-mode.json index a2b08886b..dce96a167 100644 --- a/elastic/logs/templates/component/track-shared-logsdb-mode.json +++ b/elastic/logs/templates/component/track-shared-logsdb-mode.json @@ -4,9 +4,11 @@ {% if index_mode %} "index": { "mode": {{ index_mode | tojson }}, + {% if synthetic_source_keep and synthetic_source_keep != 'none' %} "mapping": { - "synthetic_source_keep": "arrays" + "synthetic_source_keep": "{{ synthetic_source_keep }}" } + {% endif %} } {% endif %} } diff --git a/elastic/security/README.md b/elastic/security/README.md index c1e8d3f29..635948592 100644 --- a/elastic/security/README.md +++ b/elastic/security/README.md @@ -84,6 +84,7 @@ The following parameters are available: * `wait_for_status` (default: `green`) - The track creates Data Streams prior to indexing. All created Data Streams must at least reach this status before indexing commences. Reduce to `yellow` for clusters where green isn't possible e.g. single node. * `corpora_uri_base` (default: `https://rally-tracks.elastic.co`) - Specify the base location of the datasets used by this track. * `index_mode` (default: unset) - A parameter meant to be used internally which defines one of the available indexing modes, "standard", "logsdb" or "time_series". If not set, "standard" is used. +* `synthetic_source_keep` (default: unset) - Allows overriding the default synthetic source behaviour for all field types with the following values: `none` (equivalent to unset) - no source is stored, `arrays` - source stored as is only for multi-value (array) fields. ### Data Generation Parameters diff --git a/elastic/security/templates/component/track-shared-logsdb-mode.json b/elastic/security/templates/component/track-shared-logsdb-mode.json index 1f6860869..adc476be7 100644 --- a/elastic/security/templates/component/track-shared-logsdb-mode.json +++ b/elastic/security/templates/component/track-shared-logsdb-mode.json @@ -4,6 +4,11 @@ {% if index_mode %} "index": { "mode": {{ index_mode | tojson }}, + {% if synthetic_source_keep and synthetic_source_keep != 'none' %} + "mapping": { + "synthetic_source_keep": "{{ synthetic_source_keep }}" + }, + {% endif %} "sort.field": [ "host.hostname", "@timestamp" ], "sort.order": [ "asc", "desc" ], "sort.missing": ["_first", "_last"]