Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

publish container images #133

Closed
3 tasks done
axel7083 opened this issue Apr 2, 2024 · 3 comments · Fixed by #165
Closed
3 tasks done

publish container images #133

axel7083 opened this issue Apr 2, 2024 · 3 comments · Fixed by #165
Assignees

Comments

@axel7083
Copy link
Contributor

axel7083 commented Apr 2, 2024

The following images would be interesting to have available to a registry

  • models/convert_models

Required by containers/podman-desktop-extension-ai-lab#542

  • model_servers/llamacpp_python/cuda
  • model_servers/llamacpp_python/vulkan
@sallyom sallyom self-assigned this Apr 5, 2024
@sallyom
Copy link
Collaborator

sallyom commented Apr 5, 2024

I'll add them to the workflows!

@sallyom
Copy link
Collaborator

sallyom commented Apr 5, 2024

for the cuda & vulkan, I'm not sure we'll have the disk space necessary in the default actions runners but I'll try - I'll start with only x86 (I think cuda is x86 compatible only, not sure about vulkan)

@sallyom
Copy link
Collaborator

sallyom commented Apr 5, 2024

pushed & added to gh actions nightly publish with #165

  • quay.io/ai-lab/model-converter:latest for arm64, amd64
  • quay.io/ai-lab/llamacpp-python:latest arm64, amd64
  • quay.io/ai-lab/llamacpp-python-vulkan:latest arm64
  • quay.io/ai-lab/llamacpp-python-cuda:latest amd64

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

Successfully merging a pull request may close this issue.

2 participants