Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Embed workload bootable containers #119

Merged
merged 1 commit into from
Mar 29, 2024

Conversation

sallyom
Copy link
Collaborator

@sallyom sallyom commented Mar 28, 2024

This PR includes the README update PR #118
It also adds the first example for adding bootable images examples.
@rhatdan the first example I added is the generic chatbot example, since with this @lmilbaum can envision a test for the ai-app in a bootable image now (because the chatbot tests are in place)
I'll add the summarizer example next.

@sallyom sallyom force-pushed the embed-workload-bootable-containers branch 3 times, most recently from 6fc8d33 to 5ae8605 Compare March 28, 2024 23:08
@sallyom sallyom force-pushed the embed-workload-bootable-containers branch from 5ae8605 to 84c3b77 Compare March 29, 2024 03:05
@rhatdan
Copy link
Member

rhatdan commented Mar 29, 2024

Can you just move
recipes/natural_language_processing/chatbot/embed-in-bootable-image -> recipes/natural_language_processing/chatbot/bootc

You must be a better typist then me.

# podman build --build-arg "sshpubkey=$(cat ~/.ssh/mykey.pub)" -t quay.io/exampleos/example-image .
#Substitute YOUR public key for the below-private key holder for the following public key will have root access
ARG sshpubkey
ARG model-server-image=quay.io/redhat-et/locallm-model-service:latest
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should not set this default to be red hat specific.

RUN dnf install -y vim && dnf clean all

# Code-generation application
COPY quadlet/chatbot.kube.example /usr/share/containers/systemd/chatbot.kube
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this one called an example where the others are not? Source file should be chatbot.kube.

# pre-load workload images
# Comment the pull commands to keep bootc image smaller.
# With above quadlet .image file, these will be pulled on boot if not pre-loaded here
RUN podman pull quay.io/redhat-et/locallm-mistral-7b-gguf:latest
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These should all be BUILD_ARGS and should not be default to redhat site. We could grab default quay.ai/ai-lab/ which would be a much better default.

# to switch to aarch64 platform, pass --platform linux/arm64
podman build --build-arg "sshpubkey=$(cat ~/.ssh/id_rsa.pub)" \
--cap-add SYS_ADMIN \
--platform linux/amd64 \
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should not be set.


```bash
cp chatbot.yaml /usr/share/containers/systemd/chatbot.yaml
cp chatbot.kube.example /usr/share/containers/chatbot.kube
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

chatbot.kube

@rhatdan
Copy link
Member

rhatdan commented Mar 29, 2024

Ok I am going to merge and then open a PR with my suggested changes.

@rhatdan rhatdan merged commit 07fe7d2 into containers:main Mar 29, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants