Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(observability): log a single warning when buffer is full until it recovers #13369

Merged
merged 1 commit into from
Jul 15, 2024

Conversation

samugi
Copy link
Member

@samugi samugi commented Jul 12, 2024

When the log buffer was full, a log message was logged for every dropped log entry. This was causing a lot of noise.

This commit changes the behavior to only log a single message (per worker) when the log buffer is full. Another message is logged when the buffer resumes accepting new log entries.

Summary

Checklist

  • (no) The Pull Request has tests
  • A changelog file has been created under changelog/unreleased/kong or skip-changelog label added on PR if changelog is unnecessary. README.md
  • (no) There is a user-facing docs PR against https://github.com/Kong/docs.konghq.com - PUT DOCS PR HERE

Issue reference

KAG-4924

When the log buffer was full, a log message was logged for every
dropped log entry. This was causing a lot of noise.

This commit changes the behavior to only log a single message
(per worker) when the log buffer is full. Another message is logged
when the buffer resumes accepting new log entries.
@samugi samugi added this to the 3.8.0 milestone Jul 12, 2024
@github-actions github-actions bot added the cherry-pick kong-ee schedule this PR for cherry-picking to kong/kong-ee label Jul 12, 2024
@samugi samugi requested review from hanshuebner and ADD-SP July 12, 2024 12:56
@ADD-SP ADD-SP changed the title fix(observability): reduce log noise fix(observability): log a single warning when buffer is full until it recovers (#13369) Jul 15, 2024
@ADD-SP ADD-SP changed the title fix(observability): log a single warning when buffer is full until it recovers (#13369) fix(observability): log a single warning when buffer is full until it recovers Jul 15, 2024
@samugi samugi merged commit 1158224 into master Jul 15, 2024
43 checks passed
@samugi samugi deleted the fix/otel-logs-reduce-noise branch July 15, 2024 08:09
@team-gateway-bot
Copy link
Collaborator

Successfully created cherry-pick PR for master:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cherry-pick kong-ee schedule this PR for cherry-picking to kong/kong-ee size/S skip-changelog
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants