You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Aug 3, 2022. It is now read-only.
In the case that the snapshot server produces a large amount of output, it won't do to return a big JSON blob. We added support to return a stream of protobufs, but this doesn't work either unless the consumer is written very carefully to process that without additional streaming.
A more scalable approach might be this:
Have the snapshot server produce a sqlite database containing the requested data, with a standard set of mappings from Postgres to SQLite types.
Have the snapshot server simply stream that result from disk.
Clients can use the sqlite database directly if they wish, modify it, or read it and replace it with something else.
The text was updated successfully, but these errors were encountered:
In the case that the snapshot server produces a large amount of output, it won't do to return a big JSON blob. We added support to return a stream of protobufs, but this doesn't work either unless the consumer is written very carefully to process that without additional streaming.
A more scalable approach might be this:
The text was updated successfully, but these errors were encountered: