Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Web] [SD 1.5][SD Turbo][Whipser Base] Browser page out of memory - WebGPU and WebNN GPU EP #21810

Closed
ibelem opened this issue Aug 21, 2024 · 3 comments
Closed

[Web] [SD 1.5][SD Turbo][Whipser Base] Browser page out of memory - WebGPU and WebNN GPU EP #21810

ibelem opened this issue Aug 21, 2024 · 3 comments
Labels
ep:WebGPU ort-web webgpu provider ep:WebNN WebNN execution provider platform:web issues related to ONNX Runtime web; typically submitted using template

Comments

@ibelem
Copy link
Contributor

ibelem commented Aug 21, 2024 •
edited
Loading

Describe the issue

Aw, Snap! Out of memory when ORT session create started.

Environment

Chrome Canary: 129.0.6666.0
Edge Canary: 129.0.2781.0 (Chromium Version: 129.0.6655.0)
GPU Driver: 32.0.101.5768

This issue can also be reproduced with WebGPU EP:
https://microsoft.github.io/webnn-developer-preview/demos/whisper-base/?ort=1.20.0-dev.20240815-8a59b4dc4b&provider=webgpu

Tested ORT versions

  • 1.20.0-dev.20240818-417aa00406 Fail
  • 1.20.0-dev.20240815-8a59b4dc4b Fail
  • 1.19.0 Fail
  • 1.20.0-dev.20240814-a0708a0d96 Pass
  • 1.20.0-dev.20240811-154084efaa Pass

To reproduce

  1. Launch latest Chrome Canary on Windows 11
    "C:\Users\AppData\Local\Google\Chrome SxS\Application\chrome.exe" --enable-features=WebMachineLearningNeuralNetwork

  2. Visit following links

  1. If no OOM, refresh page and repeat step 2

Urgency

High

ONNX Runtime Installation

Released Package

ONNX Runtime Version or Commit ID

1.19.0, 1.20.0-dev.20240815-8a59b4dc4b

Execution Provider

'webgpu' (WebGPU), Other / Unknown
@ibelem ibelem added the platform:web issues related to ONNX Runtime web; typically submitted using template label Aug 21, 2024
@github-actions github-actions bot added ep:WebGPU ort-web webgpu provider ep:WebNN WebNN execution provider labels Aug 21, 2024
@guschmue
Copy link
Contributor

looking

@guschmue guschmue mentioned this issue Aug 21, 2024
Merged
@guschmue
Copy link
Contributor

guschmue commented Aug 21, 2024 •
edited
Loading

we've tried 3.1.64 as well and it still has some issues - reverting to 3.1.59 to buy some time for debugging

guschmue added a commit that referenced this issue Aug 22, 2024
@guschmue
Revert "Upgrade emsdk from 3.1.59 to 3.1.62" (#21817)
ba7baae 
Reverts #21421

Users are seeing chrome memory grow to 16GB before it crashes:
#21810

Revert for now so we have time to debug.
@guschmue
Copy link
Contributor

fixed. Latest dev package should have the change.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
ep:WebGPU ort-web webgpu provider ep:WebNN WebNN execution provider platform:web issues related to ONNX Runtime web; typically submitted using template
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ibelem @guschmue