Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Print warning & keep a count for prometheus when tikv raft size is exceeded #184

Open
matthewdarwin opened this issue Nov 26, 2020 · 0 comments

Comments

@matthewdarwin
Copy link

When defining an adapter for tikv, you can pass parameters like:

compression=zstd&compression_size_threshold=512000&batch_size_threshold=6000000

dfuse sometimes tries to insert data larger than the size_threshold because based on current design cannot split it into smaller chunks. If the size exceeds the tikv raft-entry-max-size parameter, then the entire insert fails. In case of insertion failure, dfuse should abort.

However, if dfuse does not abort, then a counter should be incremented and exposed to prometheus. Also log a message to the log file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant