Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

epic: powerinfer fastest infer engine ever.... #1775

Open
eix128 opened this issue Dec 8, 2024 · 0 comments
Open

epic: powerinfer fastest infer engine ever.... #1775

eix128 opened this issue Dec 8, 2024 · 0 comments
Labels
type: epic A major feature or initiative

Comments

@eix128
Copy link

eix128 commented Dec 8, 2024

powerinfer is most optimized llm inference for big models and
powerinfer is also written in C++
can you add support for powerinfer
https://github.com/SJTU-IPADS/PowerInfer
@eix128 eix128 added the type: epic A major feature or initiative label Dec 8, 2024
@github-project-automation github-project-automation bot moved this to Investigating in Jan & Cortex Dec 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type: epic A major feature or initiative
Projects
Jan & Cortex
Status: Investigating
Milestone
No milestone
Development

No branches or pull requests
1 participant
@eix128