Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Review Datablock creation strategy #72

Open
phwissmann opened this issue Jul 16, 2024 · 0 comments
Open

[Feature] Review Datablock creation strategy #72

phwissmann opened this issue Jul 16, 2024 · 0 comments
Assignees
@phwissmann
Labels
enhancement New feature or request

Comments

@phwissmann
Copy link
Collaborator

Description
Currently, all OrigDataBlocks are decompressed and all raw files are available at the same time. This requires a space for all the dataset in raw files and in the OrigDataBlocks. When the datablocks are created, additional space is needed.
Doing a "rolling" creation of DataBlocks could solve this (i.e. only unpacking the amount of necessary OrigDataBlocks for creating a new datablock)
@phwissmann phwissmann added the enhancement New feature or request label Jul 16, 2024
@phwissmann phwissmann self-assigned this Jul 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@phwissmann phwissmann

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@phwissmann