Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Kafka 0.9.0 group management #52

Open
horkhe opened this issue Feb 3, 2016 · 4 comments
Open

Add support for Kafka 0.9.0 group management #52

horkhe opened this issue Feb 3, 2016 · 4 comments

Comments

@horkhe
Copy link
Member

horkhe commented Feb 3, 2016

New set of API was introduced in Kafka 0.9.0 that allows using Kafka for consumer group management and leaving clients free of direct communication with ZooKeeper. It should be possible to make Kafka-Pixy use this API.

@Paxa
Copy link

Paxa commented Nov 3, 2017

Would be nice to have, so connection to zookeeper will be optional

@horkhe
Copy link
Member Author

horkhe commented Nov 6, 2017

@Paxa thank you for your feedback, although I won't lie to you that is not going to happen soon. I am too busy with other projects and ZooKeeper works just fine. Besides it is not like you can get rid of ZooKeeper even if Kafka-Pixy made to use the consumer group Kafka API, for Kafka itself still needs ZooKeeper.

Just curious, are you using Kafka-Pixy in some project?

@Paxa
Copy link

Paxa commented Nov 6, 2017

just wanted to try because kafka connection is complex. All consumers that I have now talk just to kafka (ruby lib, kt, rust lib)
Afaik for kafka-pixy it should be enough just talk to brokers, but may be I don't know something

@horkhe
Copy link
Member Author

horkhe commented Nov 6, 2017

When support for this API is implemented, then Kafka-Pixy will only connect to Kafka brokers, but for now it needs to connect to ZooKeeper too.

When you have tried it, it would be great if you can share your experience.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants