Update README.md

Lightning-AI · Apr 1, 2024 · e3ab4c6 · e3ab4c6
1 parent 1336976
commit e3ab4c6
Showing 1 changed file with 6 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -391,6 +391,12 @@ The LitGPT repository was the official starter kit for the [NeurIPS 2023 LLM Eff
 
 LitGPT powered the [TinyLlama project](https://github.com/jzhang38/TinyLlama) and [TinyLlama: An Open-Source Small Language Model](https://arxiv.org/abs/2401.02385) research paper.
 
+&nbsp;
+
+**🍪 MicroLlama: MicroLlama-300M**
+
+[MicroLlama](https://github.com/keeeeenw/MicroLlama) is a 300M Llama model pretrained on 50B tokens powered by TinyLlama and LitGPT.
+
 
 &nbsp;