Ladder 1xC

.gitignore

@@ -56,3 +56,4 @@ site/
 /wandb/
 /scratch/
 core
+/figure/

CHANGELOG.md

@@ -45,6 +45,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 - Added downstream eval task for requests dumped from oe-eval tasks
 - Added `CosLinearEnvelope` scheduler, which is a pointwise product of a cosine schedule and a linear decay.
 - Added ability to save outputs of submodules for debugging purposes.
+- Added scripts and notebooks for predicting loss from power laws.
 - Added a number of tasks from oe-eval to the downstream eval tasks.
 - Version dolma flan change in named_data_mix.py
 
@@ -80,6 +81,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 - Added ability to load tokenizers from `olmo_data` package data.
 - Added a script that can run a series of models with predictable scaling properties.
 
+
 ### Changed
 
 - Added original legacy unsharding implementation back, as the default. The new