Skip to content

Commit

Permalink
revert changes to common pv
Browse files Browse the repository at this point in the history
  • Loading branch information
samos123 committed Dec 5, 2024
1 parent 388a682 commit ad41a11
Show file tree
Hide file tree
Showing 3 changed files with 10 additions and 10 deletions.
3 changes: 0 additions & 3 deletions test/e2e/common-manifests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -3,13 +3,10 @@ kind: PersistentVolume
metadata:
name: kind-hostpath
spec:
storageClassName: manual
capacity:
storage: 10Gi
accessModes:
- ReadWriteMany
- ReadOnlyMany
- ReadWriteOnce
hostPath:
path: /tmp/data
type: DirectoryOrCreate
Expand Down
2 changes: 1 addition & 1 deletion test/e2e/engine-vllm-pvc/pvc.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,4 +9,4 @@ spec:
resources:
requests:
storage: 10Gi
volumeName: kind-hostpath
volumeName: kind-model-hostpath
15 changes: 9 additions & 6 deletions test/e2e/engine-vllm-pvc/test.sh
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ models_release="kubeai-models"

pip install -U "huggingface_hub[cli]"

PV_HOST_PATH=/tmp/data
PV_HOST_PATH=/tmp/model

mkdir -p ${PV_HOST_PATH}

Expand All @@ -20,12 +20,15 @@ catalog:
opt-125m-cpu:
enabled: true
url: pvc://model-pvc
minReplicas: 1
minReplicas: 2
EOF

sleep 5

curl http://localhost:8000/openai/v1/completions \
--max-time 900 \
-H "Content-Type: application/json" \
-d '{"model": "opt-125m-cpu", "prompt": "Who was the first president of the United States?", "max_tokens": 40}'
for i in {1..10}; do
echo "Sending request $i"
curl http://localhost:8000/openai/v1/completions \
--max-time 600 \
-H "Content-Type: application/json" \
-d '{"model": "opt-125m-cpu", "prompt": "Who was the first president of the United States?", "max_tokens": 40}'
done

0 comments on commit ad41a11

Please sign in to comment.