Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

INFOPLAT-1539 Beholder Log Batch Processor More Settings #957

Merged
merged 14 commits into from
Dec 20, 2024

Conversation

gheorghestrimtu
Copy link
Contributor

@gheorghestrimtu gheorghestrimtu commented Nov 28, 2024

we need to make the following settings configurable:

Batching Processor Parameters (link): Configurable parameters like maxQueueSize, scheduledDelayMillis, and maxExportBatchSize should be exposed to adjust the processing behavior based on load.

Configurable parameters:

exporter: the exporter where the LogRecords are pushed.

maxQueueSize: the maximum queue size. After the size is reached, logs are dropped. The default value is 2048.

scheduledDelayMillis: the delay interval in milliseconds between two consecutive exports. The default value is 1000.

exportTimeoutMillis: how long the export can run before it is cancelled. The default value is 30000.

maxExportBatchSize: the maximum batch size of every export. It must be smaller or equal to maxQueueSize. The default value is 512.

Requires

Supports

@gheorghestrimtu gheorghestrimtu changed the title Beholder Log Batch Processor More Settings INFOPLAT-1539 Beholder Log Batch Processor More Settings Nov 29, 2024
@gheorghestrimtu gheorghestrimtu marked this pull request as ready for review November 29, 2024 09:35
pkg/loop/config.go Outdated Show resolved Hide resolved
jmank88
jmank88 previously approved these changes Dec 4, 2024
@jmank88 jmank88 merged commit 7c7d06f into main Dec 20, 2024
10 of 11 checks passed
@jmank88 jmank88 deleted the beholder-log-batch-processor-more-settings branch December 20, 2024 12:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants