Skip to content

tensorrt-llm加速之后,只有一个cli_demo,能否实现更多的功能 #1126

Closed Answered by zRzRzRzRzRzRzR
waylean asked this question in Q&A
Discussion options

You must be logged in to vote

后期的部署方式一样吧,直接照猫画虎弄一个就行了,就没有重复造轮子了

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by zRzRzRzRzRzRzR
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants