Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: support ctx_len for model start cli #1766

Merged
merged 3 commits into from
Dec 4, 2024
Merged

fix: support ctx_len for model start cli #1766

merged 3 commits into from
Dec 4, 2024

Conversation

vansangpfiev
Copy link
Contributor

@vansangpfiev vansangpfiev commented Dec 4, 2024 •
edited
Loading

Describe Your Changes

Syntax:

cortex models start tinyllama:gguf --ctx_len 1024
cortex run tinyllama:gguf --ctx_len 1024

Fixes Issues

Self Checklist

  • Added relevant comments, esp in complex areas
  • Updated docs (for bug fixes / features)
  • Created issues for follow-up changes or refactoring needed

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Dec 4, 2024

Preview URL: https://4b163143.cortex-docs.pages.dev

@vansangpfiev vansangpfiev marked this pull request as ready for review December 4, 2024 06:22
@vansangpfiev vansangpfiev requested a review from a team December 4, 2024 06:23
@vansangpfiev vansangpfiev merged commit 2b74824 into dev Dec 4, 2024
11 checks passed
@vansangpfiev vansangpfiev deleted the fix/start-model-ctx-len branch December 4, 2024 06:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@namchuai namchuai namchuai approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vansangpfiev @namchuai