This is very first release of Langsfer.
It contains:
-
Embedding initialization methods:
- WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
- CLP-Transfer: Efficient language model training through cross-lingual and progressive transfer learning.
- FOCUS: Effective Embedding Initialization for Specializing Pretrained Multilingual Models on a Single Language.
-
Tutorial notebooks showing how to use the 3 implemented methods