Support Search request slow logs and cluster.routing.allocation.awareness.force.zone.values

[prudhvigodithi]

Description

• Coming from https://opensearch.org/docs/latest/install-and-configure/configuring-opensearch/logs/ and support Search request slow logs.

• Coming from https://opensearch.org/docs/latest/tuning-your-cluster/ support cluster.routing.allocation.awareness.force.zone.values setting.

• Added support for the provider to onboard more cluster settings which are of type list [], used typeListClusterSettings.

Issues Resolved

#209 and #202

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[prudhvigodithi]

Testing

Default

curl http://localhost:9200/_cluster/settings  -u 'admin:myStrongPassword123@456' | jq '.'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100    32  100    32    0     0   9753      0 --:--:-- --:--:-- --:--:-- 10666
{
  "persistent": {},
  "transient": {}
}

With terraform apply

Terraform will perform the following actions:

  # opensearch_cluster_settings.persistent will be created
  + resource "opensearch_cluster_settings" "persistent" {
      + cluster_max_shards_per_node                    = 10
      + cluster_search_request_slowlog_level           = "WARN"
      + cluster_search_request_slowlog_threshold_debug = "2s"
      + cluster_search_request_slowlog_threshold_info  = "5s"
      + cluster_search_request_slowlog_threshold_trace = "100ms"
      + cluster_search_request_slowlog_threshold_warn  = "10s"
      + id                                             = (known after apply)
    }

Plan: 1 to add, 0 to change, 0 to destroy.

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

Cluster output with applied Search request slow log settings

curl http://localhost:9200/_cluster/settings  -u 'admin:myStrongPassword123@456' | jq '.'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   265  100   265    0     0  74647      0 --:--:-- --:--:-- --:--:-- 88333
{
  "persistent": {
    "cluster": {
      "search": {
        "request": {
          "slowlog": {
            "level": "WARN",
            "threshold": {
              "warn": "10s",
              "trace": "100ms",
              "debug": "2s",
              "info": "5s"
            }
          }
        }
      },
      "max_shards_per_node": "10"
    },
    "plugins": {
      "index_state_management": {
        "template_migration": {
          "control": "-1"
        }
      }
    }
  },
  "transient": {}
}

[prudhvigodithi]

Hey @peterzhuamazon the spaces coming from the CLI tfplugindocs generate https://github.com/hashicorp/terraform-plugin-docs which is used to generate the docs, example https://registry.terraform.io/providers/opensearch-project/opensearch/latest/docs/resources/cluster_settings.

[prudhvigodithi]

To support the cluster.routing.allocation.awareness.force.zone.values with the list of string values example :["zoneA", "zoneB"]

curl http://localhost:9200/_cluster/settings  -u 'admin:myStrongPassword123@456' | jq '.'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   150  100   150    0     0  46210      0 --:--:-- --:--:-- --:--:-- 50000
{
  "persistent": {
    "cluster": {
      "routing": {
        "allocation": {
          "awareness": {
            "attributes": "zone",
            "force": {
              "zone": {
                "values": [
                  "zoneA",
                  "zoneB"
                ]
              }
            }
          }
        }
      }
    }
  },
  "transient": {}
}

[prudhvigodithi]

Thanks for the review @peterzhuamazon.
Adding @ironf1st @vinylen @getsaurabh02 @rblcoder.

[vinylen]

Thank you for this!