Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OpenSearch index shard based parallel processing #396

Closed
Tracked by #185
penghuo opened this issue Jun 24, 2024 · 0 comments
Closed
Tracked by #185

OpenSearch index shard based parallel processing #396

penghuo opened this issue Jun 24, 2024 · 0 comments

Comments

@penghuo
Copy link
Collaborator

penghuo commented Jun 24, 2024

A partition of an OpenSearchTable is backed by an OpenSearch Index. Each partition is split into a configurable number of shards, which are then distributed across the cluster.

We support users directly accessing OpenSearch indices without creating a table, as described in . #399.

  • A single index has one partition.
  • Wildcard indices or comma-separated indices are expanded, with each index representing a partition.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant