Replies: 2 comments
-
You can try smaller model since Mixtral 7B need 40-ish GB of RAM. With 32GB you can try 34B models. |
Beta Was this translation helpful? Give feedback.
-
I've encountered the same issue. But I've also encountered this message: The model I'm using is also: My system is: I've tried reloading, forced reload, quit the app, and restarted computer, I will attempt to switch to a smaller model to see if that helps. |
Beta Was this translation helpful? Give feedback.
-
When I'm trying to use Jan.
I got this error;
Error occurred: Failed to fetch
The module I'm trying to use:
Mixtral 8x7B Instruct Q4
My system:
Apple M1 Pro
32 GB RAM
Edit:
If it's an allocation problem (insufficient RAM), it would be nice to see it that way. Error message isn't very helpful at all.
Beta Was this translation helpful? Give feedback.
All reactions