Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase throughput of the BatchSpanProcessor #340

Merged
merged 2 commits into from
Nov 28, 2024

Conversation

matt-richardson
Copy link
Contributor

@matt-richardson matt-richardson commented Nov 28, 2024

Background

The metrics shipped with #339 helped to prove that we were dropping spans.

[sc-96078]

Results

This bumps up the batch size and queue size, which will allow large traces to be shipped without dropping spans.

In future, we may want to make these configurable via env var/system property, but for now, I'm hardcoding.

Before

Dropped spans (the green line):
image

image

After

No more dropped spans (the green line):
image

image

How to review this PR

Pre-requisites

  • I have considered informing or consulting the right people
  • I have considered appropriate testing for my change.

@matt-richardson matt-richardson self-assigned this Nov 28, 2024
@matt-richardson matt-richardson requested a review from a team as a code owner November 28, 2024 02:37
Copy link

@ahaw2024 ahaw2024 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM - good sleuthing

@matt-richardson matt-richardson merged commit 4b5e857 into main Nov 28, 2024
2 checks passed
@matt-richardson matt-richardson deleted the mattr/rsb/increase-batch-throughput branch November 28, 2024 02:40
Copy link

@akirayamamoto akirayamamoto left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 for making it configurable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants