Library cublasLt is not initialized #1222
-
|
windows11 的环境，请问我运行的 model = AutoModel.from_pretrained(MODEL_PATH, trust_remote_code=True).quantize(4).cuda().eval() 的时候出现错误RuntimeError: Library cublasLt is not initialized |
Beta Was this translation helpful? Give feedback.
Answered by
zRzRzRzRzRzRzR
May 19, 2024
Replies: 1 comment
-
|
这个是库没装吧，nvcc都没有可能就没有读取到你的cuda，nvidia smi看到的是支持的最高cuda版本 |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
zRzRzRzRzRzRzR
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
这个是库没装吧，nvcc都没有可能就没有读取到你的cuda，nvidia smi看到的是支持的最高cuda版本