New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

converting weight of more than 50G‘s .bin to .safetensors failed #519

Open

1 of 2 tasks

WongGawa opened this issue Aug 21, 2024 · 0 comments

Open

1 of 2 tasks

converting weight of more than 50G‘s .bin to .safetensors failed #519

WongGawa opened this issue Aug 21, 2024 · 0 comments

WongGawa commented Aug 21, 2024

System Info

I am using https://huggingface.co/spaces/safetensors/convert，converting google/mt5-xxl 's .bin file to .safetensors file，but it occurs error because .bin is more than 50G。
I am wondering how can this problem be solved？
Thank you。

Information

The official example scripts
My own modified scripts

Reproduction

1、https://huggingface.co/spaces/safetensors/convert
2、google/mt5-xxl
3、submit

Expected behavior

No error and get one pr。take google/mt5-xl for example。
https://huggingface.co/google/mt5-xl/discussions/2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment