Skip to content

Issues: ROCm/flash-attention

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

26 Open 14 Closed
26 Open 14 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Issue]: gfx1100 is invalid or not supported by Flash-Attention
#93 opened Nov 4, 2024 by linqingxu
1
Install flash-attention failed
#80 opened Sep 4, 2024 by sdfasfsdfasfasafd
14
[Issue]: is scaled_dot_product_attention part of flash attention?
#79 opened Sep 2, 2024 by unclemusclez
21
[Feature]: Flash Attention 3 Support for MI300X GPUs
#71 opened Aug 1, 2024 by codinggosu
[Issue]: Installing ROCm Flash-Attention on RHEL
#69 opened Jul 22, 2024 by varshaprasad96
4
[Feature]: Support for newer flash-attention versions (e.g. ≥2.1.0)
#53 opened May 22, 2024 by JiahuaZhao
2
[Issue]: Error in the implementation ?
#50 opened Mar 28, 2024 by PierreColombo
2
aac.amd: MI210 - roberta-large with sequence length 8192 and batch_size 1 fails
#46 opened Feb 28, 2024 by michaelfeil
[Feature]: Is there a Flash-Decoding algorithm implemented based on Composable kernel? function
#45 opened Feb 28, 2024 by zhangxiao-stack
3
[Issue]: Backward performance
#44 opened Feb 19, 2024 by netw0rkf10w
1
[Issue]: Unstable training
#43 opened Feb 19, 2024 by netw0rkf10w
1
[Issue]: Installation failed through Dockerfile install
#42 opened Feb 5, 2024 by amdrenwuli
4
[Issue]: RuntimeError: Expected dout_seq_stride == out_seq_stride to be true, but got false.
#41 opened Feb 3, 2024 by donglixp
@dejay-vu
15
[Issue]: Expected dout_seq_stride == out_seq_stride to be true, but got false
#40 opened Jan 30, 2024 by ehartford
1
14
Installation error install
#39 opened Jan 28, 2024 by ekazakos
2
Merge to upstream flash-attention repo upstream
#35 opened Jan 18, 2024 by ehartford
13
Support for other modules (rotary, xentropy, layer_norm) function
#34 opened Jan 15, 2024 by bbartoldson
4
replace kernel implementation using CK tile-programming performant kernels
#33 opened Jan 10, 2024 by carlushuang
4 tasks
@poyenc @carlushuang @danyao12
1
undefined symbol: hipGetDevicePropertiesR0600 navi hardware
#31 opened Jan 2, 2024 by alain40
2
can mask be supported? function
#30 opened Jan 2, 2024 by unwritten
Mi50 Support pre-mi200
#29 opened Dec 31, 2023 by YehowshuaScaled
5
installation error install
#28 opened Dec 9, 2023 by donglixp
14
RDNA3 support navi hardware
#27 opened Dec 5, 2023 by WilliamGazeley
75
MI100 Support pre-mi200
#24 opened Dec 1, 2023 by LoggerHead22
19
Feature request: Sliding Window Attention function
#22 opened Nov 29, 2023 by tjtanaa
6
ProTip! Exclude everything labeled bug with -label:bug.