RuntimeError: unable to mmap 23802932552 bytes from file <./flux1-dev.safetensors>: Cannot allocate memory (12)

[sakura-nyaa]

System Info

• transformers version: 4.44.2
• Platform: Linux-6.10.10-arch1-1-x86_64-with-glibc2.40
• Python version: 3.12.6
• Huggingface_hub version: 0.24.6
• Safetensors version: 0.4.6-dev.0
• Accelerate version: 0.34.2
• Accelerate config: not found
• PyTorch version (GPU?): 2.3.1 (True)
• Tensorflow version (GPU?): not installed (NA)
• Flax version (CPU?/GPU?/TPU?): not installed (NA)
• Jax version: not installed
• JaxLib version: not installed
• Using distributed or parallel set-up in script?: No.
• Using GPU in script?: No.
• GPU type: AMD Radeon RX 7600 XT

Information

• The official example scripts
• My own modified scripts

Reproduction

1. Download https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/flux1-dev.safetensors
2. Try to load it with ws = safe_open("./flux1-dev.safetensors", framework="pt")
3. Receive "RuntimeError: unable to mmap 23802932552 bytes from file <./flux1-dev.safetensors>: Cannot allocate memory (12)"

Expected behavior

The tensors should be lazy loaded.
I should be able to access metadata and choose to actually load a tensor into RAM/VRAM when needed.
The fact that the .safetensors file is 24 GB and I have 16 GB of RAM shouldn't affect the loading.

(I can safely lazy load a safetensors file that is around 5 GB with the exact same script, and no memory is actually allocated and everything works as expected. The issue only arises when attempting to load a safetensors file that is larger than system RAM.)