Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NotImplementedError: No operator found for memory_efficient_attention_forward with inputs: query #4976

Open
seoyeon76 opened this issue Dec 3, 2024 · 1 comment

Comments

@seoyeon76
Copy link

NotImplementedError: No operator found for memory_efficient_attention_forward with inputs: query : shape=(2, 12500, 8, 40) (torch.float16) key : shape=(2, 12500, 8, 40) (torch.float16) value : shape=(2, 12500, 8, 40) (torch.float16) attn_bias : <class 'NoneType'> p : 0.0 cutlassF is not supported because: xFormers wasn't build with CUDA support flshattF is not supported because: xFormers wasn't build with CUDA support tritonflashattF is not supported because: xFormers wasn't build with CUDA support requires A100 GPU smallkF is not supported because: xFormers wasn't build with CUDA support dtype=torch.float16 (supported: {torch.float32}) max(query.shape[-1] != value.shape[-1]) > 32 unsupported embed per head: 40

easy-stable-diffusion.ipynb - Colab - Google

I'm working on it here, but it doesn't work.
I'm a beginner.
Please help me

@seoyeon76 seoyeon76 added the bug label Dec 3, 2024
@cperry-goog
Copy link

You may have more luck contacting the notebook author if you're having a hard time with code. If you share a minimal reproducible notebook we can investigate to see if it's an issue with Colab.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants