Getting Kafka-headers using the builtin Kafka connector

[morethom]

Hi!

Title says it all, I've been trying to migrate from Kafka-connect to Conduit for our replicators and find myself needing the Kafka headers from the messages coming from the source. I can't seem to find support for that and don't necessarily want to rewrite the kafka connector just for this. As anyone been able to get this data and/or is there plans for futur support.

Thanks!

[maximus321]

finally someone said it, this is what has been preventing my migration.

[hariso]

Hey @morethom! Thanks for opening the discussion! I don't think there's any particular reason why we omitted the headers from the records. I'll open an issue for this. We'll get back to you soon with the planned milestone for it.

[hariso]

The mentioned issue: ConduitIO/conduit-connector-kafka#125.

[morethom]

Thanks for the quick response @hariso ! This feature would make the Conduit migration alot easier for my team, love the project so far. I'll be waiting for a follow-up!

[hariso]

Here's the pull request: ConduitIO/conduit-connector-kafka#126.