Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fixing llamacpp pytyon docs and makefile #163

Merged

Conversation

Gregory-Pereira
Copy link
Collaborator

Part 1 of sepereating out #132 /cc @MichaelClifford @sallyom @rhatdan


.PHONY: test
test:
pytest --log-cli-level NOTSET
pytest --log-cli-level NOTSET
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should the tests also do a make all on this Makefile?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can add in a follow-up @lmilbaum

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have added a version of this, let me know if I should remove it


```bash
make -f Makefile models/mistral-7b-instruct-v0.1.Q4_K_M.gguf
make -f Makefile mistral-7b-instruct-v0.1.Q4_K_M.gguf
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Make mistral and llama variables defined above.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this implementation look acceptable? I feel like users should be able to trigger a download without knowing the full model name

@Gregory-Pereira Gregory-Pereira force-pushed the fix-llammacpp-ms-docs-and-make branch from 7a31c9e to 7346200 Compare April 6, 2024 02:02
@rhatdan
Copy link
Member

rhatdan commented Apr 6, 2024

LGTM

@Gregory-Pereira Gregory-Pereira force-pushed the fix-llammacpp-ms-docs-and-make branch from 7346200 to 2cf35c1 Compare April 6, 2024 03:21
@Gregory-Pereira
Copy link
Collaborator Author

Forgot to update the workflows, I will add those changes now.

@rhatdan
Copy link
Member

rhatdan commented Apr 6, 2024

LGTM

@rhatdan rhatdan merged commit 7000344 into containers:main Apr 6, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants