Skip to content

Triage records in Kafka dead letter queue (DLQ) topics

License

Notifications You must be signed in to change notification settings

alexanderabramov/kafka-triage

Repository files navigation

kafka-triage build status

Triage records in Kafka dead letter queue (DLQ) topics

Local development

Get docker and docker compose.

# from ./docker/
./up.sh

Copy application-dev-example.yml to application-dev.yml and adjust as necessary.

Database setup on GCP Kubernetes

Create a GCP Cloud SQL instance

https://cloud.google.com/sql/docs/postgres/

gcloud sql instances create dbk-prod-kafka-triage --database-version=POSTGRES_9_6 --region europe-west4  \
    --storage-size=10GB --tier db-f1-micro --backup
gcloud sql users set-password postgres no-host --instance kafka-triage --prompt-for-password
gcloud sql databases create kafka-triage --instance=kafka-triage

Connect from GCP Kubernetes

https://cloud.google.com/sql/docs/postgres/connect-kubernetes-engine