Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
rasbt authored Apr 14, 2024
1 parent b392e78 commit 7d2b726
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -105,6 +105,8 @@ litgpt chat \
--checkpoint_dir out/phi-2-lora/final
```

 

### Pretrain an LLM
Train an LLM from scratch on your own data via pretraining:

Expand Down Expand Up @@ -132,6 +134,8 @@ litgpt chat \
--checkpoint_dir out/custom-model/final
```

 

### Continue pretraining an LLM
This is another way of finetuning that specialize an already pretrained model by training on custom data:

Expand Down

0 comments on commit 7d2b726

Please sign in to comment.