From 4239ffb8fd746074625a97da2a1c3cfc936befb5 Mon Sep 17 00:00:00 2001 From: Todsaporn Banjerdkit Date: Mon, 6 Nov 2023 14:00:32 +0700 Subject: [PATCH] [Example] Add RTX 4090 to perf table (#60) --- wasmedge-ggml-llama-interactive/README.md | 11 ++++++----- 1 file changed, 6 insertions(+), 5 deletions(-) diff --git a/wasmedge-ggml-llama-interactive/README.md b/wasmedge-ggml-llama-interactive/README.md index d46e35a..e59a8d3 100644 --- a/wasmedge-ggml-llama-interactive/README.md +++ b/wasmedge-ggml-llama-interactive/README.md @@ -184,11 +184,12 @@ wasmedge --dir .:. \ Welcome to submit PR to upload the TPS <3 -| WasmEdge | Hardware | OS | Model | TPS | -| - | - | - | - | - | -| 0.13.5 | M2 Max 64GB | macOS 13.6 | llama-2-7b-chat.Q5\_K\_M | 12.68 | -| 0.13.5 | i7-10700 + NVIDIA GTX 1080 8G | Ubuntu 22.04 | llama-2-7b-chat.Q5\_K\_M | 31.73 | -| 0.13.5 | AWS g5.xlarge A10G 24G | Amazon Deep Learning base Ubuntu 20.04 | llama-2-7b-chat.Q5\_K\_M | 71.48 | +| WasmEdge | Hardware | OS | Model | TPS | +| - | - | - | - | - | +| 0.13.5 | M2 Max 64GB | macOS 13.6 | llama-2-7b-chat.Q5\_K\_M | 12.68 | +| 0.13.5 | i7-10700 + NVIDIA GTX 1080 8G | Ubuntu 22.04 | llama-2-7b-chat.Q5\_K\_M | 31.73 | +| 0.13.5 | AWS g5.xlarge A10G 24G | Amazon Deep Learning base Ubuntu 20.04 | llama-2-7b-chat.Q5\_K\_M | 71.48 | +| 0.13.5 | i7-13700K + NVIDIA RTX 4090 24G | Windows 11 WSL2 Ubuntu 22.04 | llama-2-7b-chat.Q5\_K\_M | 111.90 | ## Errors