Kafdrop – Kafka Web UI  

Kafdrop is a web UI for viewing Kafka topics and browsing consumer groups. The tool displays information such as brokers, topics, partitions, consumers, and lets you view messages.

Entrar no localhost:9000 para ver a UI do Kafka com todos os tópicos e dados sendo transmitidos.

This project is a reboot of Kafdrop 2.x, dragged kicking and screaming into the world of JDK 11+, Kafka 2.x, Helm and Kubernetes. It's a lightweight application that runs on Spring Boot and is dead-easy to configure, supporting SASL and TLS-secured brokers.

Features

• View Kafka brokers — topic and partition assignments, and controller status
• View topics — partition count, replication status, and custom configuration
• Browse messages — JSON, plain text, Avro and Protobuf encoding
• View consumer groups — per-partition parked offsets, combined and per-partition lag
• Create new topics
• View ACLs
• Support for Azure Event Hubs

Tutorial que me ensinou isso:

https://youtu.be/JJEKPqSlXvk

Getting Started

Kafka:

Executar docker-compose up na pasta /docker-compose/kafka-kafdrop/ para iniciar o Kafka.

NestJS:

• Api-gateway: Seria como o back-nacional, ele receberia a requisição REST pegaria os dados no banco e enviaria pro Python via Kafka;
• Nest-microservice: Seria como o Python, um microservico que fica ouvindo o Kafka à espera de uma nova entrada na fila;

Iniciar o NEST:

Entrar na pasta do api-gateway/ e nest-microservice/ e executar 'npm i' depois 'npm run start:dev' para cada pasta.

Enviar um pedido:

Atualizar nosso Postman ou criar uma rota nesse estilo: