Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat/s3: implementing pika storage on s3 using the rocksdb-cloud library #1985

Merged
merged 10 commits into from
Sep 27, 2023

Conversation

longfar-ncy
Copy link
Contributor

  1. 使用rocksdb-cloud替换rocksdb,主要是将原本使用 rocksdb::DB 的地方替换为 rocksdb::DBCloud 并用宏包裹起来,以及一些配置信息的传递,包括tests中使用的地方。
  2. 在cmake中增加编译选项USE_S3=[ON/OFF]来开启/关闭是否使用rocksdb-cloud,若使用,增加拉取rocksdb-cloud库的命令和链接相关动态库命令
  3. 增加有关rocksdb-cloud的配置选项
  4. 由于使用rocksdb-cloud的pika启动较慢,改动了./tests/integration/start_master_and_slave.sh脚本
  5. 增加新工作流 pika_cloud.yml,pika.yml仍然以不使用rocksdb-cloud的方式编译,pika_cloud.yml增加安装aws sdk和启动minio用于测试的步骤,编译pika时开启USE_S3选项。但centos和mac的工作流还未能成功。

@wangshao1 wangshao1 changed the base branch from unstable to OpenAtom-S3 September 22, 2023 01:53
@wangshao1 wangshao1 merged commit 35fc787 into OpenAtomFoundation:OpenAtom-S3 Sep 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants