Try to use this community to discuss patterns and libraries

[solsson]

Confluent's tooling is easy to learn about, but we often find ourselves looking for lighter alternatives and support for other languages. Streaming designs appear to be gaining momentum, but we're not finding the kind of ecosystem growth we'd expect for such a potent technology. More ears and eyes are clearly needed.

[StevenACoffman]

So I would personally love an example of autoscaling consumers based on consumer lag. Perhaps using burrow? Using the Custom Metrics Adapter for Prometheus means we can horizontally autoscale consumers on arbitrary metrics that we already collect with Prometheus, such as consumer lag using Burrow. I'm not sure if anyone has already done this, but I'm looking for examples, and the closest mention I've been able to find is linkedin/Burrow#341