This marks the first stable release of CalBERT rewrite (#1) 🎉🎉
Highlights
- 🔁Removed non-essential dependencies and rewrote the entire model using PyTorch
- 📤New classes for creating the
CalBERTDataset
, theCalBERT
model andSiamesePretrainer
to perform Siamese Pre-training - 🚀Implemented as a PyTorch module, allowing it to be modified or be extensively used by other networks as a layer
- ⚙️New training configurations - checkpoints, save strategies, loss metrics and more
- 📦Packaged CalBERT as a module that can be installed via
pip
Full Changelog: https://github.com/aditeyabaral/calbert/commits/v1.0.0