Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Torch compile - any way to take advantage of it? #1

Open
Adreitz opened this issue May 3, 2023 · 1 comment
Open

Torch compile - any way to take advantage of it? #1

Adreitz opened this issue May 3, 2023 · 1 comment
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@Adreitz
Copy link

Adreitz commented May 3, 2023

It might be too new to work with MPS, but this new fix in Diffusers is supposed to provide large speedups on nVidia. Just putting it here for safe keeping & possible future implementation.

huggingface/diffusers#3313
@brkirch brkirch added enhancement New feature or request good first issue Good for newcomers labels May 8, 2023
@brkirch
Copy link
Owner

brkirch commented May 8, 2023

Currently PyTorch does not appear to be able to do torch.compile with these models on MPS, but if that changes in future PyTorch versions I'll add it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@brkirch @Adreitz