Skip to content

0.1.0

Latest
Compare
Choose a tag to compare
@Jaseunda Jaseunda released this 21 Mar 15:12
· 7 commits to master since this release

LocalAI - Your Personal AI on Your Computer

LocalAI is an AI-powered chatbot that runs locally on your computer, providing a personalized AI experience without the need for internet connectivity. It utilizes a massive neural network with 60 billion parameters, making it one of the most powerful chatbots available. The public version of LocalAI currently utilizes a 13 billion parameter model. With its availability on Mac, Windows, Linux, and Android platforms, LocalAI is your personal AI assistant that can help you with a wide range of tasks.

Instructions

To use LocalAI, follow these instructions:

  1. Install Python 3 on your computer.
  2. Clone the LocalAI repository from GitHub.
  3. Install the required Python modules by running the following command in the terminal: pip install termcolor json.
  4. Download the 13 billion parameter model from the LocalAI website and save it in the models/13B/ directory.
  5. Run the main.py file to start LocalAI.
  6. Type in your question or request and LocalAI will do its best to help you.
  7. To end the conversation, type exit.
  8. To change your display name, type /change username <new_name>.

Configuration

To configure LocalAI, you can modify the config.json file. Here's an example configuration file:

{
    "seed": -1,
    "threads": 4,
    "n_predict": 1,
    "model_path": "Your model location",
    "top_k": 40,
    "top_p": 0.9,
    "temp": 0.1,
    "repeat_last_n": 64,
    "repeat_penalty": 1.3
}