feat: migrate to using LiteLLM for LLM and Embedding as backbone #24

thehapyone · 2024-04-29T06:00:41Z

This PR updates sage codebase to use LiteLLM for all AI models loadings.

Others:

Update docs to show litellm usage
Adds support for loading any kind of Huggingface embedding models via the new class LocalEmbeddings
Removes the JinaAIEmbeddings
Resolve migrate to using LiteLLM as LLM provider #23

…to WARNING

…eLLM and also support generic HuggingFace embeddings

…ions

thehapyone added 7 commits April 24, 2024 20:27

feat: migrate towards loading llm provider via the liteLLM API

08a1b86

fix: pipe all deps logging to the customlogger and set logging level …

adc3689

…to WARNING

feat: adds support for migrating the embeddings towards using the Lit…

09aa5f5

…eLLM and also support generic HuggingFace embeddings

docs: update the documentation for using sage with new LLM configurat…

a2b8273

…ions

docs: clean up sample envs

e52969f

fix: set sentence-transformer to high version

6f8cabb

docs: update sample embedding config

9ab648a

thehapyone merged commit 316a46a into main Apr 29, 2024
2 checks passed

thehapyone deleted the feat/migrate_to_litellm branch April 29, 2024 06:22

Provide feedback