You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
At the moment the post processing step of read scales linearly with the number of columns.
This is caused by the calls to make_block and when we have many columns(150k+) it is taking about half of the time of the total read.
Describe the bug
At the moment the post processing step of read scales linearly with the number of columns.
This is caused by the calls to make_block and when we have many columns(150k+) it is taking about half of the time of the total read.
Steps/Code to Reproduce
Expected Results
The post processing step should take too much time
OS, Python Version and ArcticDB Version
Python 3.10
Backend storage used
LMDB
Additional Context
No response
The text was updated successfully, but these errors were encountered: