You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the solution you'd like
As remote store depends on repository plugin to store/restore segments to/from the remote store, before creating the index with remote_store=true, it is required to create the repository first. As part of the change introduced in #3285, the repository name is hardcoded. But it takes away the flexibility and would create issues if the repository with the same name exists. The repository name should be configurable.
The text was updated successfully, but these errors were encountered:
Any hard-coded or predetermined name of the repository can conflict with an already existing repository that the customer might have. [Note: @sachinpkale is currently using clusterId as the repository name]
For a configurable name or a name that the customer wants to choose, we might have to expose it as a cluster setting, preferably a non dynamic one (point 3 explains why), and hence, the repository name has to be initialised in the settings file (yml) of all the nodes for it to be picked up. The problem here might be that the repository name is now confined to the scope of the node and not at a global cluster level.
If the customer goes ahead and updates the bucket endpoint of the same repository via the PUT API, it is the same scenario as updating the remote store repository name altogether. In both cases, i.e. new remote store repository being created or the already created repository's bucket endpoints being updated, we will have to do the heavy lifting of pushing all the data of every remote store index again, to this new bucket.
Considering all the above points, can we allow this remote store repository name to be a cluster level dynamic setting (giving the option to the customer to update the name) and calling out the repercussions of this change (re-pushing the entire data in case of the endpoint or the repository name being changed)
Please feel free to add any other thoughts/concerns regarding this.
Describe the solution you'd like
As remote store depends on repository plugin to store/restore segments to/from the remote store, before creating the index with
remote_store=true
, it is required to create the repository first. As part of the change introduced in #3285, the repository name is hardcoded. But it takes away the flexibility and would create issues if the repository with the same name exists. The repository name should be configurable.The text was updated successfully, but these errors were encountered: