Replies: 1 comment
-
我们提供了int4的量化办法,int4版本还没有推出,我们收到了反馈,有新消息将会第一时间公示 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
需要提供能直接上手使用的4bit量化后版本,以便于小容量机器直接使用
Beta Was this translation helpful? Give feedback.
All reactions