Add support for AWS MSK IAM authentication

[korsosa]

Planning to merge this change upstream, please visit the PR in the official Logstash plugins repository for more information:
logstash-plugins#126

[99ttz]

is it possible to get a build published until the PR gets approved? getting from source code to ruby gem is a head scratcher :(. thank you!

[korsosa]

Hey @99ttz ! sure, I uploaded a release:
https://github.com/korsosa/logstash-integration-kafka/releases/tag/logstash-integration-kafka-10.12.0-iam

I have an open pull-request upstream and waiting on Elastic to merge this into the main Kafka plugin. If that happens, then this MSK IAM auth support will be part of the official Kafka plugin.
I suggest to follow the PR logstash-plugins#126 and once it's merged, switch back to the official Kafka plugin from this custom build.

[99ttz]

thank you very much!

[korsosa]

Hey @99ttz, I wrote a Github gist on how to build the Logstash plugin. I couldn't build the plugin based on the Logstash readmes or Elastic's documentation but found a way to build it in Docker and wanted to document it for anyone who might need it (also for myself).

If you'd like to build your own Logstash plugin gem, feel free to give it a go:
https://gist.github.com/korsosa/d58b8fdaa733716c19837795d75257ea

[otavioprado]

@robbavey when this PR will be merged?