Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SeasLog可以同步给ClickHouse么？一键上远程 支持大数据分析搜索 使用UDP的DEMO案例？ #314

Open
letwang opened this issue Mar 18, 2022 · 2 comments
Open

SeasLog可以同步给ClickHouse么？一键上远程 支持大数据分析搜索 使用UDP的DEMO案例？ #314

letwang opened this issue Mar 18, 2022 · 2 comments

Comments

@letwang
Copy link

letwang commented Mar 18, 2022

如图，HookPHP发来贺电~

SeasLog可以同步给ClickHouse么？一键上远程 支持大数据分析搜索 使用UDP的DEMO案例？
@Rock-Lee-520
Copy link
Member

如图，HookPHP发来贺电~

SeasLog可以同步给ClickHouse么？一键上远程 支持大数据分析搜索 使用UDP的DEMO案例？

理论上可以实现,在扩展里封装调用SeasClick的函数即可,但是在扩展里直接用UDP写Clickhouse存在几个问题，
1、CK的性能并没有那么高（并发间隔1s）,
2、CK适合大批量写入（上千数据），也就是需要在内存或者磁盘中缓存日志数据，赞成一批以后再写
3、PHP的FPM模式下，进程执行10万次左右会重启，申请的内存会释放掉

如果真要实现是否用Seaslog写Kafka 或者Spark 这种批处理引擎， 然后往CK一批一批写更合适？

@letwang
Copy link
Author

letwang commented Jul 13, 2022

Seaslog可以写到RabbitMQ么？我在从RabbitMQ到ClickHouse？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@letwang @Rock-Lee-520