Address suggestions

Lightning-AI · Oct 6, 2023 · 6c6ee4b · 6c6ee4b
1 parent c50ed45
commit 6c6ee4b
Show file tree

Hide file tree

Showing 3 changed files with 2 additions and 10 deletions.
diff --git a/README.md b/README.md
@@ -102,7 +102,7 @@ pip install -r requirements.txt
 Install with all dependencies (including quantization, sentencepiece, tokenizers for Llama models, etc.):
 
 ```bash
-pip install -r requirements.txt -r requirements-extra.txt
+pip install -r requirements-all.txt
 ```
 
 **(Optional) install Flash Attention 2**

diff --git a/requirements-extra.txt → requirements-all.txt b/requirements-extra.txt → requirements-all.txt
@@ -1,3 +1,4 @@
+-r requirements.txt
 bitsandbytes   # quantization
 scipy          # required by bitsandbytes
 sentencepiece  # pythia, falcon, redpajama

diff --git a/requirements.txt b/requirements.txt
@@ -1,12 +1,3 @@
 torch>=2.1.0
 lightning @ git+https://github.com/Lightning-AI/lightning@71aed751f7f0ca8422ddca256e602099070f490b
 jsonargparse[signatures]  # CLI
-
-# other optional dependencies are
-# sentencepiece  # pythia, falcon, redpajama
-# bitsandbytes # quantization
-# tokenizers  #  llama-based models
-# datasets  # quantize/gptq.py
-# zstandard  # scripts/prepare_redpajama.py
-# git+https://github.com/EleutherAI/lm-evaluation-harness.git@master  # eval
-# pandas  # prepare_csv.py