Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Potential RabbitMQ connection leak #6266

Open
xaka opened this issue Oct 23, 2024 · 0 comments
Open

Potential RabbitMQ connection leak #6266

xaka opened this issue Oct 23, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@xaka
Copy link

xaka commented Oct 23, 2024

Report

I've got ~600 scaled objects with similar rabbitmq config:

  triggers:
  - metadata:
      host: amqp://guest:[email protected]:5672
      mode: QueueLength
      protocol: amqp
      queueName: <unique-id>:queue
      value: "1"
      vhostName: /
    type: rabbitmq

Count TOP-10 connections by host

rabbitmq-0:/# rabbitmqctl list_connections | awk '
NR > 2 {count[$2]++}
END {
    for (host in count) {
        print host, count[host]
    }
}' | sort -k2,2nr | head -n 10
172.31.17.39 10369
172.31.26.39 1305
172.31.12.223 907
172.31.41.74 388
172.31.37.14 2
172.31.10.181 1
172.31.10.40 1
172.31.10.46 1
172.31.11.119 1
172.31.11.209 1

In this case 172.31.17.39 is keda operator pod and it opened 10k connections so far (5 days). The number is growing over time until rabbitmq gets stuck.

Expected Behavior

Number of connections is stable over time and doesn't grow

Actual Behavior

Connections are being opened over time, but never closed/disposed

Steps to Reproduce the Problem

N/A

Logs from KEDA operator

N/A

KEDA Version

2.15.1

Kubernetes Version

1.29

Platform

Amazon Web Services

Scaler Details

RabbitMQ

Anything else?

No response

@xaka xaka added the bug Something isn't working label Oct 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: To Triage
Development

No branches or pull requests

1 participant