From 7bb498fb1700ee7c0415b352d6e689edcb918da5 Mon Sep 17 00:00:00 2001 From: William Falcon Date: Sat, 13 Apr 2024 16:07:59 -0400 Subject: [PATCH] Update README.md --- README.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 34706620f9..ef39c4fd4f 100644 --- a/README.md +++ b/README.md @@ -105,6 +105,7 @@ litgpt chat \ --checkpoint_dir out/phi-2-lora/final ``` +### Pretrain an LLM Train an LLM from scratch on your own data via pretraining: ```bash @@ -131,7 +132,8 @@ litgpt chat \ --checkpoint_dir out/custom-model/final ``` -Specialize an already pretrained model by training on custom data: +### Continue pretraining an LLM +This is another way of finetuning that specialize an already pretrained model by training on custom data: ``` mkdir -p custom_texts