Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

using jackson streaming api for large amounts of json #42

Closed
henryw374 opened this issue Dec 30, 2020 · 4 comments
Closed

using jackson streaming api for large amounts of json #42

henryw374 opened this issue Dec 30, 2020 · 4 comments

Comments

@henryw374
Copy link

henryw374 commented Dec 30, 2020

I've created a gist to show reading and writing json in a streamed style - specifically where you have a large array of objects. https://gist.github.com/henryw374/5e41464d386942910b50d1af02bded61 not sure if you had thought about adding something like this to the api or not, but anyway.. still handy to have a demo example

... and if you can see any mistakes there please let me know ;-)

Thanks

@ohpauleez
Copy link
Contributor

I've used a similar approach in the projects where I needed streams of JSON. I tend to use reducibles/reducible-seqs instead of actual Sequences/lazy-seq. You can make some other smaller tweaks to keep GC churn low and application throughput a bit higher if your application is centered around the JSON stream.

@bsless
Copy link
Contributor

bsless commented Jun 7, 2021

see #53 and #55, possibly coming soon

@opqdonut
Copy link
Member

See docs/streaming.md

@henryw374
Copy link
Author

new streaming api looks good. cheers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants