Skip to content

Commit

Permalink
Mention Ollama in the docs
Browse files Browse the repository at this point in the history
  • Loading branch information
jtpio committed Jul 10, 2024
1 parent 3ba6de3 commit 0dbcc87
Show file tree
Hide file tree
Showing 2 changed files with 23 additions and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ in JupyterLab and the Jupyter Notebook. More specifically, Jupyter AI offers:
* A native chat UI in JupyterLab that enables you to work with generative AI as a conversational assistant.
* Support for a wide range of generative model providers, including AI21, Anthropic, AWS, Cohere,
Gemini, Hugging Face, MistralAI, NVIDIA, and OpenAI.
* Local model support through GPT4All, enabling use of generative AI models on consumer grade machines
* Local model support through GPT4All and Ollama, enabling use of generative AI models on consumer grade machines
with ease and privacy.

Documentation is available on [ReadTheDocs](https://jupyter-ai.readthedocs.io/en/latest/).
Expand Down
22 changes: 22 additions & 0 deletions docs/source/users/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -357,6 +357,28 @@ GPT4All support is still an early-stage feature, so some bugs may be encountered
during usage. Our team is still actively improving support for locally-hosted
models.

### Ollama usage (early-stage)

Jupyter AI provides basic support for Ollama models.

To get started, follow the instructions on the [Ollama website](https://ollama.com/) to set up `ollama` and download the models locally. Currently Jupyter AI only supports the following models:

- `gemma`
- `gemma2`
- `llama2`,
- `llama3`,
- `llama3:70b`,
- `phi3`,
- `mistral`,
- `tinyllama`,
- `qwen2`,
- `qwen2:7b`,
- `qwen2:72b`,

:::{note}
There are plans to make the list of Ollama models configurable in the future, so users can download more models available via Ollama.
:::

### Asking about something in your notebook

Jupyter AI's chat interface can include a portion of your notebook in your prompt.
Expand Down

0 comments on commit 0dbcc87

Please sign in to comment.