Jan
Replies: 2 comments 1 reply
-
|
I think you can just look at the Recommended models 😄 |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Are those recommendations based off system specs or is it the same for everyone I wonder.. |
Beta Was this translation helpful? Give feedback.
-
|
You can try any 7B models like Dolphin Mistral, or Solar 10.7B. Some 13b models may struggle with 16GB RAM. And any bigger may actually lead critical system failure. I don't recommend it. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Got a M1 Pro Macbook with 16GB ram. Would it completely choke trying to run one of the larger models? (20-40GB). Any experiences?
Beta Was this translation helpful? Give feedback.
All reactions