Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Saving various data types to disk #22

Open
matham opened this issue May 31, 2023 · 0 comments
Open

Saving various data types to disk #22

matham opened this issue May 31, 2023 · 0 comments

Comments

@matham
Copy link
Contributor

matham commented May 31, 2023

tree_config.yaml package is meant to be dealing with precisely this issue. I.e. to be able to dump anything as a string with yaml_dumps that can then be loaded again as needed. And it's meant to handle numpy/torch and other basic types that h5 may not be able to represent by default.

Or you can try a different approach e.g. just calling repr(value). But for config stuff I think tree_config should work as that is how things are saved/loaded already. So instead of creating a dataset for each item, I'd create a group and save all the properties as metadata dict values with str being both key and value.

Originally posted by @matham in #1 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant