Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Connector supports get key value with RedisKeysSourceConnector #34

Open
caiounderscore opened this issue Jan 9, 2024 · 0 comments
Open

Comments

@caiounderscore
Copy link
Contributor

caiounderscore commented Jan 9, 2024

Hi folks,

I have a question, if it makes sense I'd like to suggest a feature.

I have an application that uses Redis to save temporary data, but this data is important for me for in future auditories. I don't want to use redis stream

I could add an extra step in my application after saving the data in Redis and then putting the data in kafka topic, but I don't want my application to have kafka dependency and overhead. So I want to use Redis connector to extract keys and their values ​​and put them in the kafka.

I saw the RedisKeysSourceConnector is based in redis keyspace notifications but it is not possible to report a value (stackoverflow question). The value is the most important thing for me.

Does It make sense to implement in the RedisKeysSourceConnectoror create a new connector class for the following steps (I could try to implement it):

  1. Connector receives any event from key (keyspace notifications based)
  2. The connector gets value from the key
  3. Connector put the data keyspace notifications and key value in the topic

If somebody has other suggestions or solutions I would appreciate a lot.

Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant