Skip to content

Commit

Permalink
Merge pull request ggerganov#212 from mzbac/patch-1
Browse files Browse the repository at this point in the history
chore: add note for Mac m1 installation
  • Loading branch information
abetlen authored May 15, 2023
2 parents cbac19b + 3718799 commit cda9cec
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,12 @@ pip install llama-cpp-python
The above command will attempt to install the package and build build `llama.cpp` from source.
This is the recommended installation method as it ensures that `llama.cpp` is built with the available optimizations for your system.

Note: If you are using Apple Silicon (M1) Mac, make sure you have installed a version of Python that supports arm64 architecture. For example:
```
wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-MacOSX-arm64.sh
bash Miniforge3-MacOSX-arm64.sh
```
Otherwise, while installing it will build the llama.ccp x86 version which will be 10x slower on Apple Silicon (M1) Mac.

### Installation with OpenBLAS / cuBLAS / CLBlast

Expand Down

0 comments on commit cda9cec

Please sign in to comment.