Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide zstd compressed install only release artifacts? #304

Open
indygreg opened this issue Aug 25, 2024 · 2 comments
Open

Provide zstd compressed install only release artifacts? #304

indygreg opened this issue Aug 25, 2024 · 2 comments

Comments

@indygreg
Copy link
Owner

This project's release artifacts are continuing to gain popularity.

I initially only published the zstd compressed full archives for use with PyOxidizer. Then when people discovered the utility of the distributions and they wanted smaller downloadable artifacts, we made the install_only archive variants. I chose .tar.gz at the time because of the ubiquity of zlib and knew I couldn't get away with zstd only.

We still need to provide gzip archives for compatibility I suspect. But I'm wondering if we should provide zstd compressed archives so customers could speed up decompression by a few seconds. This could matter for things like GitHub Actions. Every second can count!

WDYK @charliermarsh? Would uv benefit from the speedup from zstd archives?

@indygreg
Copy link
Owner Author

Actually, the time savings may be <1.0 now with the stripped distributions. The size of the debug symbols and raw object files made zstd a very obvious advantage with the full archives. But maybe gzip with stripped is small enough the >5x slower decompression doesn't translate to a meaningful wall time difference?

@charliermarsh
Copy link
Collaborator

We could try it out and benchmark it in uv? We seamlessly support gzip and zstd already, so we’d just need to generate the assets.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants