Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rocm-build/navi10 for Stable Diffusion (for example: AUTOMATIC1111/stable-diffusion-webui) #36

Open
EvgeniiLavrinov opened this issue Oct 10, 2022 · 5 comments

Comments

@EvgeniiLavrinov
Copy link

Hello! I don't know much about coding and compilations.
I don’t understand if it’s possible to use your instructions to make the rx5700 (navi10) card work in Stable Diffusion.
Can you help me figure it out? Or maybe there is an opportunity to make a patch that will add support for rx5700 card in the AUTOMATIC1111 build?

@xuhuisheng
Copy link
Owner

I am afraid there is no guarantee for navi10 run properly on ROCm, as AMD didn't test navi10 in there development environment totally.

My patch is just let ROCm can run mnist with tensoflow/pytorch on navi10. But there is more easier way to do that, we can use an environment variable export HSA_OVERRIDE_GFX_VERSION=10.3.0 to pretend navi10 is a navi21 card, to let tensoflow-rocm/pytorch run on it. It is surprised mnist run sucessfully.

Emm~, rebuild may be more stable, but HSA_OVERRIDE way is more easier.

I'm not familar with stable diffussion, if it can run with tensorflow or pytorch, you can try HSA_OVERRIDE way.

Or, could you provide some instructions for using stable diffusion, that I can have a try when I have time. Now I am a little busy to test gfx803 on blender.

@EvgeniiLavrinov
Copy link
Author

I can only say that I acted according to the instructions from this page. I used "running inside docker" section. (I'm on Ubuntu 20.04)

Running with "--no-half" alias enables Stable Diffusing without using GPU, CPU only mode (which means very slow generation)

@xuhuisheng
Copy link
Owner

Unfortunately, I test navi10 - RX5700xt hanging on ROCm-5.3.

So I guess navi10 may not support stable-diffusion.

@cloudyangel
Copy link

Unfortunately, I test navi10 - RX5700xt hanging on ROCm-5.3.

So I guess navi10 may not support stable-diffusion.

with
export HSA_OVERRIDE_GFX_VERSION=10.3.0
and other 2 parameters described in the repo 'SD' , the SD could run under GPU mode and its speed is much faster than the one under Windows.

@xuhuisheng
Copy link
Owner

xuhuisheng commented Apr 5, 2023

Interesting, Cgmb said the ISA of RDNA1 is different with RDNA2, so RX5700xt cannot use 10.3.0 directly.

Unfortunately, I test navi10 - RX5700xt hanging on ROCm-5.3.
So I guess navi10 may not support stable-diffusion.

with export HSA_OVERRIDE_GFX_VERSION=10.3.0 and other 2 parameters described in the repo 'SD' , the SD could run under GPU mode and its speed is much faster than the one under Windows.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants