Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support large transactions for Postgres #745

Open
cilesizemre opened this issue Mar 17, 2022 · 0 comments
Open

Support large transactions for Postgres #745

cilesizemre opened this issue Mar 17, 2022 · 0 comments

Comments

@cilesizemre
Copy link

We are having some problems with our Postgres integrations with a transaction that generates more than 1 GB on our replication_slot. In these kinds of problems, we are needed to stop the integration and restart it again.

As I can understand this is because of the limitations on Postgres implementation, if there is a transaction that generates more than 1 GB of data wal2json plugin couldn't handle this. Because of this issue, there are some configuration parameters on the wal2json side like format-version and write-in-chunks

It seems using format-version=2 and write-in-chunks=true look promising.

Is there a way to use these parameters for wal2json or any other way to handle large transactions for Postgres implementation?

@cilesizemre cilesizemre changed the title Support for large transactions for Postgres Support large transactions for Postgres Mar 17, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant