Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[js/node] fix CUDA artifact installation script for Linux/x64 #22984

Merged
merged 1 commit into from
Dec 4, 2024

Conversation

fs-eire
Copy link
Contributor

@fs-eire fs-eire commented Dec 2, 2024

Description

Background: There is a max size limit for NPM package, so it is impossible to include CUDA binaries inside onnxruntime-node. I made the install script js/node/script/install.js for onnxruntime-node to allow users to download the CUDA binaries from github.

Before 1.18.x, there are both onnxruntime-win-x64-gpu-1.18.0.zip and onnxruntime-win-x64-gpu-cuda12-1.18.0.zip in the github release assets, containing the CUDA v11 bits and CUDA v12 bits.

  • --onnxruntime-node-install-cuda[=v11] will download file https://github.com/microsoft/onnxruntime/releases/download/v{VERSION}/onnxruntime-win-x64-gpu-{VERSION}.zip
  • --onnxruntime-node-install-cuda=v12 will download file https://github.com/microsoft/onnxruntime/releases/download/v{VERSION}/onnxruntime-win-x64-gpu-cuda12-{VERSION}.zip

Since 1.19.x, CUDA v12 became default and the onnxruntime-win-x64-gpu-cuda12-{VERSION}.zip is no longer provided in Github release assets.

This PR updates installation script to fix it for CUDA v12. However, it may be difficult for CUDA v11 since the steps are quite complicated to automate. Added a few lines of instructions instead.

fixes #22877

@fs-eire fs-eire merged commit d3bc318 into main Dec 4, 2024
95 checks passed
@fs-eire fs-eire deleted the fs-eire/node-install-script-fix branch December 4, 2024 00:07
ankitm3k pushed a commit to intel/onnxruntime that referenced this pull request Dec 11, 2024
…oft#22984)

### Description

This PR updates installation script to fix it for CUDA v12. However, it
may be difficult for CUDA v11 since the steps are quite complicated to
automate. Added a few lines of instructions instead.

fixes microsoft#22877
ankitm3k pushed a commit to intel/onnxruntime that referenced this pull request Dec 11, 2024
…oft#22984)

### Description

This PR updates installation script to fix it for CUDA v12. However, it
may be difficult for CUDA v11 since the steps are quite complicated to
automate. Added a few lines of instructions instead.

fixes microsoft#22877
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[cuda] [npm/nodejs] Failed to download the binaries: 404 Not Found
2 participants