We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
It would be great if you could set common inference parameters such as top_p and num_ctx.
top_p
num_ctx
min_p
repetition_penalty
I think they're the most commonly used parameters, however a complete list is available https://github.com/ollama/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values
The text was updated successfully, but these errors were encountered:
Successfully merging a pull request may close this issue.
It would be great if you could set common inference parameters such as
top_p
andnum_ctx
.top_p
helps control quality vs creativity (much smarter than temperature)min_p
another, newer algorithm for quality vs creativity (some would argue even smarter than top_p)num_ctx
configures what context size to load the model withrepetition_penalty
configures how much repetition is allowed in the generations (this is an oversimplification but it's useful)I think they're the most commonly used parameters, however a complete list is available https://github.com/ollama/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values
The text was updated successfully, but these errors were encountered: