Skip to content

Issues: ROCm/flash-attention

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

24 Open 16 Closed
24 Open 16 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Issue]: gfx1100 is invalid or not supported by Flash-Attention
#93 opened Nov 4, 2024 by linqingxu
1
Install flash-attention failed
#80 opened Sep 4, 2024 by sdfasfsdfasfasafd
15
[Issue]: is scaled_dot_product_attention part of flash attention?
#79 opened Sep 2, 2024 by unclemusclez
21
[Feature]: Flash Attention 3 Support for MI300X GPUs
#71 opened Aug 1, 2024 by codinggosu
[Issue]: Installing ROCm Flash-Attention on RHEL
#69 opened Jul 22, 2024 by varshaprasad96
4
[Feature]: Support for newer flash-attention versions (e.g. ≥2.1.0)
#53 opened May 22, 2024 by JiahuaZhao
2
[Issue]: Error in the implementation ? Under Investigation
#50 opened Mar 28, 2024 by PierreColombo
2
[Feature]: Is there a Flash-Decoding algorithm implemented based on Composable kernel? function
#45 opened Feb 28, 2024 by zhangxiao-stack
3
[Issue]: Backward performance
#44 opened Feb 19, 2024 by netw0rkf10w
1
[Issue]: Unstable training
#43 opened Feb 19, 2024 by netw0rkf10w
1
[Issue]: Installation failed through Dockerfile install
#42 opened Feb 5, 2024 by amdrenwuli
4
[Issue]: RuntimeError: Expected dout_seq_stride == out_seq_stride to be true, but got false.
#41 opened Feb 3, 2024 by donglixp
@dejay-vu
15
[Issue]: Expected dout_seq_stride == out_seq_stride to be true, but got false
#40 opened Jan 30, 2024 by ehartford
1
14
Merge to upstream flash-attention repo upstream
#35 opened Jan 18, 2024 by ehartford
13
Support for other modules (rotary, xentropy, layer_norm) function
#34 opened Jan 15, 2024 by bbartoldson
4
replace kernel implementation using CK tile-programming performant kernels
#33 opened Jan 10, 2024 by carlushuang
4 tasks
@poyenc @carlushuang @danyao12
1
undefined symbol: hipGetDevicePropertiesR0600 navi hardware Under Investigation
#31 opened Jan 2, 2024 by alain40
2
can mask be supported? function
#30 opened Jan 2, 2024 by unwritten
Mi50 Support pre-mi200
#29 opened Dec 31, 2023 by YehowshuaScaled
5
installation error install
#28 opened Dec 9, 2023 by donglixp
14
RDNA3 support navi hardware
#27 opened Dec 5, 2023 by WilliamGazeley
76
MI100 Support pre-mi200
#24 opened Dec 1, 2023 by LoggerHead22
20
Feature request: Sliding Window Attention function
#22 opened Nov 29, 2023 by tjtanaa
6
Install failed install
#20 opened Nov 27, 2023 by 1787648106
12
ProTip! Adding no:label will show everything without a label.