tensorrt-llm加速之后,只有一个cli_demo,能否实现更多的功能 #1126
-
tensorrt-llm加速之后,只有一个cli_demo,能不能部署一个gradio的demo啊,再加上langchain更好了,求大神解答 |
Beta Was this translation helpful? Give feedback.
Answered by
zRzRzRzRzRzRzR
Apr 13, 2024
Replies: 1 comment
-
后期的部署方式一样吧,直接照猫画虎弄一个就行了,就没有重复造轮子了 |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
zRzRzRzRzRzRzR
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
后期的部署方式一样吧,直接照猫画虎弄一个就行了,就没有重复造轮子了