Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deduplicating Alerts #213

Open
BillyFnh opened this issue Mar 20, 2024 · 1 comment
Open

Deduplicating Alerts #213

BillyFnh opened this issue Mar 20, 2024 · 1 comment

Comments

@BillyFnh
Copy link

Hi team, currently I have this setup:

  • Prometheus rule group with scope of Azure Monitor Workspace
  • The rules in the rule group have an action group associated, which will call a HTTP based slack webhook to send alerts

What I'm trying to achieve:

  • When the condition is met for a certain rule, I expected the alert to fire once and subsequent evaluations to the rule to either do nothing or update to the existing alert

Current reality of my setup:

  • When the condition is met for a certain rule, new alerts will keep firing on each subsequent evluation of the rule

I've tried looking for configuration that will help me achieve the desired behavior but with no luck.
So far I've tried:

  • Setting the evaluation interval to a higher value, but this only delays the alert firing, not deduplicate it
  • Processing rule to supress alerts, but it seems to only supress by time of day etc, not deduplicate

Is there a config that I'm not aware of or is this a mechanism not yet implemented in Azure Monitor?

@crypto-billy
Copy link

Hello @noakup hope you're doing well!

Apologies if you're not the correct person to reach out to, but I see that you were quite responsive on other issues and I was hoping you could help get some attention on this issue 🙏🏻

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants