Skip to content

Commit

Permalink
Merge pull request #117 from fractalego/frontend-windows
Browse files Browse the repository at this point in the history
added funding and increased the chunk size for indexing docs
  • Loading branch information
fractalego authored Jul 22, 2024
2 parents 98633df + 1b41337 commit b4ef736
Show file tree
Hide file tree
Showing 4 changed files with 6 additions and 3 deletions.
1 change: 1 addition & 0 deletions .github/FUNDING.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
buy_me_a_coffee: fractalego
4 changes: 2 additions & 2 deletions documentation/source/installation.rst
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ The second command starts the audio interface as well as a web server on port 80
Please see the examples in the following chapters.


LLM side (needs a GPU)
LLM side (needs a GPU to be efficient)
----------------------
The second part (LLM side) is a model server for the speech-to-text model, the LLM, the embedding system, and the text-to-speech model.
In order to quickly run the LLM side, you can use the following installation commands:
Expand All @@ -41,7 +41,7 @@ In order to quickly run the LLM side, you can use the following installation com
$ pip install wafl-llm
$ wafl-llm start
which will use the default models and start the server on port 8080.
which will use the default models and start the server on port 8080.

The interface side has a `config.json` file that needs to be filled with the IP address of the LLM side.
The default is localhost.
Expand Down
2 changes: 2 additions & 0 deletions todo.txt
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
* multiple knowledge bases, one for internal facts and one for each indexed paths
* perhaps a way to structure the prompt using <> tags. The memory items need to be distinct.
* use poetry

/* why is the cache not working? The system re-loads the knowledge every time
Expand Down
2 changes: 1 addition & 1 deletion wafl/readers/reader_factory.py
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@


class ReaderFactory:
_chunk_size = 1000
_chunk_size = 10000
_overlap = 100
_extension_to_reader_dict = {".pdf": PdfReader, ".txt": TextReader}

Expand Down

0 comments on commit b4ef736

Please sign in to comment.