I want to know can every Datanode use same s3 as storage? #3339
Answered
by
waynexia
Murasame233
asked this question in
Q&A
-
I want to know can every Datanode use same s3 as storage?
|
Beta Was this translation helpful? Give feedback.
Answered by
waynexia
Feb 20, 2024
Replies: 1 comment 5 replies
-
Yes. Datanodes in one cluster can use the same S3 bucket and root. They'll coordinate things like access permission and directory by themselves.
This is also supported after v0.6. When a node is down, meta server will failover data to other available nodes. You can also schedule workload manually, see region migration. Notice these functionalities rely on shared storage services. Like kafka for WAL and S3 for storage. |
Beta Was this translation helpful? Give feedback.
5 replies
Answer selected by
Murasame233
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Yes. Datanodes in one cluster can use the same S3 bucket and root. They'll coordinate things like access permission and directory by themselves.
This is also supported after v0.6. When a node is down, meta server will failover data to other available nodes. You can also schedule workload manually, see region migration. Notice these functionalities rely on shared storage services. Like kafka for WAL and S3 for storage.