Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Incorrect prometheus metric label names in Temporal server metrics grafana dashboard. #42

Open
jupudibhaskar967 opened this issue Jan 20, 2023 · 0 comments
Labels
bug Something isn't working

Comments

@jupudibhaskar967
Copy link

We are trying to integrate the Temporal Server Metrics grafana dashboard on our self managed grafana server and some of charts are not displaying any data.

Description

In the server metrics grafana dashboard, there is a section (row) where there is information about Workflow completion stats and currently all those charts are not displaying any data even with valid metrics. After taking a closer look at the prometheus queries, all the queries are using sum aggregations on the label name "temporal_namespace" but the temporal server pods are publishing metrics with label name "namespace" and because of this mismatch, the charts are not working. Basically, all the charts under this section are not displaying anything.

Example metric from worker pod:
image

Temporal server version: 1.19.0

@jupudibhaskar967 jupudibhaskar967 added the bug Something isn't working label Jan 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant