Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Upload model on podman machine - Qemu #439

Closed
wants to merge 7 commits into from

Conversation

lstocchi
Copy link
Contributor

@lstocchi lstocchi commented Mar 1, 2024

What does this PR do?

This is built over #204 and add the part for qemu.
This also needs desktop with podman-desktop/podman-desktop#5848
When starting a recipe, the model is uploaded to the podman machine for a fast model service loading

Screenshot / video of UI

N/A

What issues does this PR fix or reference?

it resolves #421

How to test this PR?

  1. start a recipe, when you see the app is started, open the sample app in the browser, you should be able to play with it without waiting 2-3mins that the model gets loaded.

@lstocchi lstocchi changed the title feat: Upload model qemu feat: Upload model on podman machine - Qemu Mar 1, 2024
Signed-off-by: lstocchi <[email protected]>
@lstocchi
Copy link
Contributor Author

Closing as not needed -> #421

@lstocchi lstocchi closed this Mar 11, 2024
@lstocchi lstocchi deleted the uploadModelQemu branch March 11, 2024 10:01
mhdawson pushed a commit to mhdawson/podman-desktop-extension-ai-lab that referenced this pull request Nov 22, 2024
intel training container is now pulling in vllm container
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Upload model on podman machine so model service starts quickly - QEMU
1 participant