Development

.github/FUNDING.yml

@@ -0,0 +1,2 @@
+github: fractalego
+buy_me_a_coffee: fractalego

documentation/source/installation.rst

@@ -31,7 +31,7 @@ The second command starts the audio interface as well as a web server on port 80
 Please see the examples in the following chapters.
 
 
-LLM side (needs a GPU)
+LLM side (needs a GPU to be efficient)
 ----------------------
 The second part (LLM side) is a model server for the speech-to-text model, the LLM, the embedding system, and the text-to-speech model.
 In order to quickly run the LLM side, you can use the following installation commands:
@@ -41,7 +41,7 @@ In order to quickly run the LLM side, you can use the following installation com
     $ pip install wafl-llm
     $ wafl-llm start
 
-    which will use the default models and start the server on port 8080.
+which will use the default models and start the server on port 8080.
 
 The interface side has a `config.json` file that needs to be filled with the IP address of the LLM side.
 The default is localhost.

todo.txt

@@ -1,3 +1,5 @@
+* multiple knowledge bases, one for internal facts and one for each indexed paths
+* perhaps a way to structure the prompt using <> tags. The memory items need to be distinct.
 * use poetry
 
 /* why is the cache not working? The system re-loads the knowledge every time

wafl/readers/reader_factory.py

@@ -3,7 +3,7 @@
 
 
 class ReaderFactory:
-    _chunk_size = 1000
+    _chunk_size = 10000
     _overlap = 100
     _extension_to_reader_dict = {".pdf": PdfReader, ".txt": TextReader}