This repository has been archived by the owner on Aug 30, 2024. It is now read-only.
[Neural Speed] Greedy_search & Top_p_top_k sampling & Eval in cont-batching #665
Job | Run time |
---|---|
1s | |
1s | |
1s | |
1s | |
1s | |
5s |
Job | Run time |
---|---|
1s | |
1s | |
1s | |
1s | |
1s | |
5s |