diff --git a/README.md b/README.md index ef39c4fd4f..17cb709a08 100644 --- a/README.md +++ b/README.md @@ -25,14 +25,24 @@ Uses the latest state-of-the-art techniques: Finetune, pretrain LLMsModelsFeatures • - Training recipes (YAML) • - Design principles + Training recipes (YAML)

  +## Finetune, pretrain and deploy AI models Lightning fast ⚡⚡ +LitGPT is a command-line tool to use, pretrain, finetune and deploy LLMs. It is based on configs with highly-optimized recipes for training the world's largest, most powerful open-source LLMs. + +We've reimplemented all the model architectures and training recipes for 3 reasons: + +1. Remove all abstraction layers and have single file implementations. +2. Guarantee Apache 2.0 compliance to enable enterprise use without limits. +3. Optimized every detail of every model to get the fastest performance possible to lower cost and training speeds. + +  + ## Install LitGPT Install LitGPT with all dependencies (including CLI, quantization, tokenizers for all models, etc.): @@ -60,8 +70,7 @@ pip install -e '.[all]' --- # Get started -LitGPT is a command-line tool to use, pretrain, finetune and deploy LLMs. - +LitGPT is CLI and config-based. Select the model and the action you want to take on that model (finetune, pretrain, evaluate, deploy, etc...):