Skip to content

Commit

Permalink
[Example] Update the installation guide of ggml interactive example (#56
Browse files Browse the repository at this point in the history
)

Signed-off-by: hydai <[email protected]>
  • Loading branch information
hydai authored Nov 4, 2023
1 parent 3f93dd0 commit ad7480c
Showing 1 changed file with 26 additions and 3 deletions.
29 changes: 26 additions & 3 deletions wasmedge-ggml-llama-interactive/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,9 +17,32 @@ source $HOME/.zshenv

### For Ubuntu (>= 20.04)

Because we enabled OpenBLAS on Ubuntu, you must install `libopenblas-dev` by `apt update && apt install -y libopenblas-dev`.
#### CUDA enabled

Install WasmEdge 0.13.4+WASI-NN ggml plugin(OpenBLAS enabled) via installer
The installer from WasmEdge 0.13.5 will detect cuda automatically.

If CUDA is detected, the installer will always attempt to install a CUDA-enabled version of the plugin.

Install WasmEdge 0.13.4+WASI-NN ggml plugin via installer

```bash
curl -sSf https://raw.githubusercontent.com/WasmEdge/WasmEdge/master/utils/install.sh | bash -s -- --plugin wasi_nn-ggml
# After install the wasmedge, you have to activate the environment.
# Assuming you use bash (the default shell on Ubuntu), you will need to run the following command
source $HOME/.bashrc
```

This version is verified on the following platforms:
1. Nvidia Jetson AGX Orin 64GB developer kit
2. Intel i7-10700 + Nvidia GTX 1080 8G GPU

#### CPU only

If CPU is the only available hardware on your machine, the installer will install OpenBLAS version of plugin instead.

You may need to install `libopenblas-dev` by `apt update && apt install -y libopenblas-dev`.

Install WasmEdge 0.13.4+WASI-NN ggml plugin via installer

```bash
apt update && apt install -y libopenblas-dev # You may need sudo if the user is not root.
Expand All @@ -36,7 +59,7 @@ Install WasmEdge 0.13.4+WASI-NN ggml plugin via installer
```bash
curl -sSf https://raw.githubusercontent.com/WasmEdge/WasmEdge/master/utils/install.sh | bash -s -- --plugin wasi_nn-ggml
# After install the wasmedge, you have to activate the environment.
# Assuming you use bash (the default shell on Ubuntu), you will need to run the following command
# Assuming you use bash (the default shell on Linux), you will need to run the following command
source $HOME/.bashrc
```

Expand Down

0 comments on commit ad7480c

Please sign in to comment.