Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Go fast Fix #358

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

Go fast Fix #358

wants to merge 2 commits into from

Conversation

HPPinata
Copy link
Contributor

This makes flash_attn a bit more flexible in regards to the head dimensions, etc. supported.
Reference Beinsezii/comfyui-amd-go-fast#3.

Also make sure the Docker container doesn't exit when doing an rm of a non existant file.

This shouldn't change existing behaviour (apart from the docker fix).

@HPPinata
Copy link
Contributor Author

Some of the test failures showed me there are still a couple things left to figure out before this can be merged. I might consider splitting this PR into the easy fixes around Docker and the install script and the more involved sdpa_hijack

@HPPinata HPPinata force-pushed the go-fast-fix branch 2 times, most recently from c2d2387 to b1ba5c1 Compare November 24, 2024 01:17
@HPPinata HPPinata mentioned this pull request Nov 24, 2024
@HPPinata HPPinata marked this pull request as draft November 24, 2024 04:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant