LocalAI - Your Personal AI on Your Computer
LocalAI is an AI-powered chatbot that runs locally on your computer, providing a personalized AI experience without the need for internet connectivity. It utilizes a massive neural network with 60 billion parameters, making it one of the most powerful chatbots available. The public version of LocalAI currently utilizes a 13 billion parameter model. With its availability on Mac, Windows, Linux, and Android platforms, LocalAI is your personal AI assistant that can help you with a wide range of tasks.
Instructions
To use LocalAI, follow these instructions:
- Install Python 3 on your computer.
- Clone the LocalAI repository from GitHub.
- Install the required Python modules by running the following command in the terminal:
pip install termcolor json
. - Download the 13 billion parameter model from the LocalAI website and save it in the
models/13B/
directory. - Run the
main.py
file to start LocalAI. - Type in your question or request and LocalAI will do its best to help you.
- To end the conversation, type
exit
. - To change your display name, type
/change username <new_name>
.
Configuration
To configure LocalAI, you can modify the config.json
file. Here's an example configuration file:
{
"seed": -1,
"threads": 4,
"n_predict": 1,
"model_path": "Your model location",
"top_k": 40,
"top_p": 0.9,
"temp": 0.1,
"repeat_last_n": 64,
"repeat_penalty": 1.3
}