You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@alamb FYI pagination also relevant for local context
I agree
One way to do this might be to wrap the SendableRecordBatchStream in an object that buffers past results and fetches next result on demand. Something like this perhaps
structSendableRecordBatchStream{// currently executing streaminner:SendableRecordBatchStream,// any batches that have been buffered so farbatches:Vec<RecordBatch>,// current batch being showncurrent_batch:usize,}implSendableRecordBatchStream{/// return the next batch in the streamasyncfnnext(&self) -> &RecordBatch{self.current_batch += 1;self.current()}/// go to current_indexasyncfncurrent(&self) -> &RecordBatch{whileself.batches.len()+1 < current_batch {// fetch next batch from inner and put into self.batches}self.batches[self.current_batch]}}
I ran a query on local context that returned a large number of rows and the app became unresponsive after completing. We need to paginate somehow
The text was updated successfully, but these errors were encountered: