Skip to content

Commit

Permalink
minor fixes to kempner docs (#354)
Browse files Browse the repository at this point in the history
  • Loading branch information
epwalsh authored Nov 2, 2023
1 parent 026793e commit a952f44
Showing 1 changed file with 3 additions and 4 deletions.
7 changes: 3 additions & 4 deletions docs/Kempner.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,19 +21,18 @@ Getting started
```

4. `aws configure`
5. Install Miniconda
5. Install Miniconda with `wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh && bash Miniconda3-latest-Linux-x86_64.sh`, then follow prompts. You'll probably want to log out and back in after this.
6. `conda create -y -n LLM python=3.10 ipython`
7. `conda activate LLM`
8. `conda install -y pytorch torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidia`
9. `git clone https://github.com/allenai/LLM.git`
10. `cd LLM`
11. `pip install -e .`
12. Set up S3 key env vars (in `~/.bashrc`)
13. Pre-download all the downstream evals. In a Python shell:
12. Pre-download all the downstream evals. In a Python shell:

```bash
from olmo.eval.downstream import *
tokenizer = Tokenizer.from_file("tokenizers/allenai_eleuther-ai-gpt-neox-20b-pii-special.json")
for x in label_to_task_map.values():
x(tokenizer=tokenizer)
```
```

0 comments on commit a952f44

Please sign in to comment.