Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

什么时候支持sink到clickhouse #494

Open
wyfaq opened this issue Mar 13, 2023 · 5 comments · May be fixed by #619
Open

什么时候支持sink到clickhouse #494

wyfaq opened this issue Mar 13, 2023 · 5 comments · May be fixed by #619
Labels
enhancement New feature or request

Comments

@wyfaq
Copy link

wyfaq commented Mar 13, 2023

Describe the feature

我看官方介绍https://loggie-io.github.io/docs/user-guide/enterprise-practice/architecture-and-evolution/ 是支持到ck的，但是却没有相关文档，请问现在是否支持？
@wyfaq wyfaq added the enhancement New feature or request label Mar 13, 2023
@ethfoo
Copy link
Collaborator

ethfoo commented Mar 16, 2023 •
edited
Loading

预计在q2支持。
当前可以通过kafka中转到ck。

@zhangkang07
Copy link

请问一下，什么时候可以支持sink到ClickHouse呢

@ethfoo
Copy link
Collaborator

ethfoo commented Jul 24, 2023

请问一下，什么时候可以支持sink到ClickHouse呢

排期在下半年，可以考虑发到Kafka然后转到CK

@zhangkang07
Copy link

请问一下，什么时候可以支持sink到ClickHouse呢

排期在下半年，可以考虑发到Kafka然后转到CK

好的，谢谢

@zhu733756
Copy link
Contributor

zhu733756 commented Aug 24, 2023 •
edited
Loading

有大佬在搞这块么？我想提交一个pr来支持一下~ @ethfoo

大概做法：

  • 使用clickhouse-go batch client (之前有比较过，比sqlx性能要好)去构建一个连接，获取batch去发送，由于clickhouse对大批量写比较友好，要不要做缓存数据的处理？
  • 要不要给定schema支持自动ddl呢，Init的时候

小尾巴：

  • 这两周关注到loggie这个项目，很不错的国产日志metrics云原生引擎，有没有可能参与一下

@zhu733756 zhu733756 linked a pull request Aug 25, 2023 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Feat: add sink clickhouse zhu733756/loggie
4 participants
@ethfoo @wyfaq @zhu733756 @zhangkang07