-
Notifications
You must be signed in to change notification settings - Fork 115
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Embed workload bootable containers #119
Embed workload bootable containers #119
Conversation
6fc8d33
to
5ae8605
Compare
Signed-off-by: sallyom <[email protected]>
5ae8605
to
84c3b77
Compare
Can you just move You must be a better typist then me. |
# podman build --build-arg "sshpubkey=$(cat ~/.ssh/mykey.pub)" -t quay.io/exampleos/example-image . | ||
#Substitute YOUR public key for the below-private key holder for the following public key will have root access | ||
ARG sshpubkey | ||
ARG model-server-image=quay.io/redhat-et/locallm-model-service:latest |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should not set this default to be red hat specific.
RUN dnf install -y vim && dnf clean all | ||
|
||
# Code-generation application | ||
COPY quadlet/chatbot.kube.example /usr/share/containers/systemd/chatbot.kube |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why is this one called an example where the others are not? Source file should be chatbot.kube.
# pre-load workload images | ||
# Comment the pull commands to keep bootc image smaller. | ||
# With above quadlet .image file, these will be pulled on boot if not pre-loaded here | ||
RUN podman pull quay.io/redhat-et/locallm-mistral-7b-gguf:latest |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
These should all be BUILD_ARGS and should not be default to redhat site. We could grab default quay.ai/ai-lab/ which would be a much better default.
# to switch to aarch64 platform, pass --platform linux/arm64 | ||
podman build --build-arg "sshpubkey=$(cat ~/.ssh/id_rsa.pub)" \ | ||
--cap-add SYS_ADMIN \ | ||
--platform linux/amd64 \ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should not be set.
|
||
```bash | ||
cp chatbot.yaml /usr/share/containers/systemd/chatbot.yaml | ||
cp chatbot.kube.example /usr/share/containers/chatbot.kube |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
chatbot.kube
Ok I am going to merge and then open a PR with my suggested changes. |
This PR includes the README update PR #118
It also adds the first example for adding bootable images examples.
@rhatdan the first example I added is the generic
chatbot
example, since with this @lmilbaum can envision a test for the ai-app in a bootable image now (because the chatbot tests are in place)I'll add the summarizer example next.