Skip to content

Commit

Permalink
add Jan inter
Browse files Browse the repository at this point in the history
  • Loading branch information
hahuyhoang411 committed Nov 23, 2023
1 parent 27e9547 commit 07f6ac1
Show file tree
Hide file tree
Showing 5 changed files with 40 additions and 56 deletions.
21 changes: 20 additions & 1 deletion docs/docs/demos/chatbox-vid.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,23 @@
title: Run local chatbox under 1 minute on MacOS with Nitro
---

<iframe width="675" height="380" src="https://www.youtube.com/embed/_AQXQDjw7Y8" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>
<iframe width="675" height="380" src="https://www.youtube.com/embed/apfI13ijvjc" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

## Links

- [Download Nitro](https://github.com/janhq/nitro/releases)
- [Download Chatbox](https://github.com/Bin-Huang/chatbox)

## Commands

```bash title="Load model"
curl http://localhost:3928/inferences/llamacpp/loadmodel \
-H 'Content-Type: application/json' \
-d '{
"llama_model_path": "model/llama-2-7b-chat.Q5_K_M.gguf",
"ctx_len": 512,
"ngl": 100,
}'
```

For more information, please refer to the [Nitro with Chatbox](examples/chatbox.md) documentation.
2 changes: 1 addition & 1 deletion docs/docs/examples/chatbox.md
Original file line number Diff line number Diff line change
Expand Up @@ -60,4 +60,4 @@ Once the setup is complete, you can start chatting with the model using Chatbox.

## Futher Usage

For convenient usage, you can utilize [Jan](https://jan.ai/), as it is integrated with Nitro.
For convenient usage, you can utilize [Jan](https://jan.ai/), as it is integrated with Nitro.
18 changes: 18 additions & 0 deletions docs/docs/examples/jan.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
---
title: Nitro with Jan
---

You can effortlessly utilize Nitro through [Jan](https://jan.ai/), as it is fully integrated with all its functions. With Jan, using Nitro becomes straightforward without the need for any coding.


<iframe width="675" height="380" src="https://www.youtube.com/embed/hw9w8_54OIc" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

## What is Jan?

Jan is a ChatGPT-alternative that runs on your own computer, with a local API server.

Jan uses open-source AI models, stores data in open file formats, is highly customizable via extensions.

For additional details, please consult the [Jan Documenation](https://jan.ai/docs).

> [Download Jan](https://jan.ai/)
54 changes: 0 additions & 54 deletions docs/docs/examples/llm.md

This file was deleted.

1 change: 1 addition & 0 deletions docs/sidebars.js
Original file line number Diff line number Diff line change
Expand Up @@ -59,6 +59,7 @@ const sidebars = {
collapsible: false,
collapsed: false,
items: [
"examples/jan",
"examples/chatbox",
"examples/openai-node",
"examples/openai-python",
Expand Down

0 comments on commit 07f6ac1

Please sign in to comment.