Skip to content

Commit

Permalink
Add finetune studio link (#1314)
Browse files Browse the repository at this point in the history
  • Loading branch information
rasbt authored Apr 17, 2024
1 parent c5adaa0 commit 209d0fd
Showing 1 changed file with 10 additions and 0 deletions.
10 changes: 10 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -155,6 +155,12 @@ For more information, refer to the [download](tutorials/download_model_weights.m
### Finetune an LLM
[Finetune](tutorials/finetune.md) a model to specialize it on your own custom dataset:

<a target="_blank" href="https://lightning.ai/lightning-ai/studios/litgpt-finetune">
<img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/>
</a>

&nbsp;

```bash
# 1) Download a pretrained model
litgpt download --repo_id microsoft/phi-2
Expand All @@ -174,6 +180,8 @@ litgpt chat \
--checkpoint_dir out/phi-2-lora/final
```

&nbsp;

### Pretrain an LLM
Train an LLM from scratch on your own data via pretraining:

Expand Down Expand Up @@ -201,6 +209,8 @@ litgpt chat \
--checkpoint_dir out/custom-model/final
```

&nbsp;

### Continue pretraining an LLM
This is another way of finetuning that specialize an already pretrained model by training on custom data:

Expand Down

0 comments on commit 209d0fd

Please sign in to comment.