Compatibility Issues with httpx Version and GPU/CPU Behavior

[jia-shan]

I encountered the following compatibility issues when running the run_rag.py script in an environment created with rye:

1. httpx Version Conflict:

   • The environment works fine for processing and indexing tasks.
   • However, when running run_rag.py, the script requires httpx to be downgraded to 0.27.2 for it to work.
     (Originally at 0.28.0, this error appeared: ImportError: cannot import name 'VerifyTypes' from 'httpx._types'.)
   • Downgrading httpx to versions smaller than 0.25.0 causes conflicts.

2. GPU/CPU Behavior with transformers:

   • If the desired behavior is to use the CPU by default, transformers==4.46.0 is compatible.
   • To use the GPU by default, it works only with transformers==4.47.0 (on my laptop at least).

Suggestions:

• It might be beneficial to freeze the versions of all libraries to avoid these issues.
• After downgrading the libraries, everything worked fine, but I do not know if the problem is system-dependent.
• Additionally, I noticed that the requirements.txt files are not updated, so it might be better to remove them

Distributive system: Ubuntu 24.04.1 LTS

[Stefanstud]

The issue should be fixed - master has been updated. We are also planning to release this as a PyPI package soon.