Skip to content

Commit

Permalink
[Example] Add RTX 4090 to perf table (#60)
Browse files Browse the repository at this point in the history
  • Loading branch information
katopz authored Nov 6, 2023
1 parent 2df9eb8 commit 4239ffb
Showing 1 changed file with 6 additions and 5 deletions.
11 changes: 6 additions & 5 deletions wasmedge-ggml-llama-interactive/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -184,11 +184,12 @@ wasmedge --dir .:. \

Welcome to submit PR to upload the TPS <3

| WasmEdge | Hardware | OS | Model | TPS |
| - | - | - | - | - |
| 0.13.5 | M2 Max 64GB | macOS 13.6 | llama-2-7b-chat.Q5\_K\_M | 12.68 |
| 0.13.5 | i7-10700 + NVIDIA GTX 1080 8G | Ubuntu 22.04 | llama-2-7b-chat.Q5\_K\_M | 31.73 |
| 0.13.5 | AWS g5.xlarge A10G 24G | Amazon Deep Learning base Ubuntu 20.04 | llama-2-7b-chat.Q5\_K\_M | 71.48 |
| WasmEdge | Hardware | OS | Model | TPS |
| - | - | - | - | - |
| 0.13.5 | M2 Max 64GB | macOS 13.6 | llama-2-7b-chat.Q5\_K\_M | 12.68 |
| 0.13.5 | i7-10700 + NVIDIA GTX 1080 8G | Ubuntu 22.04 | llama-2-7b-chat.Q5\_K\_M | 31.73 |
| 0.13.5 | AWS g5.xlarge A10G 24G | Amazon Deep Learning base Ubuntu 20.04 | llama-2-7b-chat.Q5\_K\_M | 71.48 |
| 0.13.5 | i7-13700K + NVIDIA RTX 4090 24G | Windows 11 WSL2 Ubuntu 22.04 | llama-2-7b-chat.Q5\_K\_M | 111.90 |

## Errors

Expand Down

0 comments on commit 4239ffb

Please sign in to comment.