Skip to content

Commit

Permalink
Update default config for Zenith services
Browse files Browse the repository at this point in the history
  • Loading branch information
sd109 committed Nov 5, 2024
1 parent 60e6ace commit af6310f
Show file tree
Hide file tree
Showing 4 changed files with 10 additions and 3 deletions.
3 changes: 3 additions & 0 deletions charts/azimuth-chat/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,9 @@ azimuth-llm:
ui:
image:
repository: ghcr.io/stackhpc/azimuth-llm-chat-ui
service:
zenith:
enabled: true
appSettings:
model_name: *model-name
model_instruction: "You are a helpful AI assistant; please respond appropriately."
4 changes: 4 additions & 0 deletions charts/azimuth-image-analysis/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,5 +4,9 @@ azimuth-llm:
ui:
image:
repository: ghcr.io/stackhpc/azimuth-llm-image-analysis-ui
service:
zenith:
enabled: true
label: Image Analysis Interface
appSettings:
model_name: *model-name
2 changes: 1 addition & 1 deletion charts/azimuth-llm/templates/ui/ui-zenith-reservation.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@ metadata:
spec:
credentialSecretName: {{ .Release.Name }}-ui-zenith-credential
{{- end -}}
{{- end -}}
{{- end -}}
4 changes: 2 additions & 2 deletions charts/azimuth-llm/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -46,10 +46,10 @@ api:
zenith:
enabled: false
skipAuth: false
label: Inference API
label: OpenAI API
iconUrl: https://raw.githubusercontent.com/vllm-project/vllm/v0.2.7/docs/source/assets/logos/vllm-logo-only-light.png
description: |
The raw inference API endpoints for the deployed LLM.
The OpenAI API for the deployed LLM.
# Config for huggingface model cache volume
# This is mounted at /root/.cache/huggingface in the api deployment
cacheVolume:
Expand Down

0 comments on commit af6310f

Please sign in to comment.