Skip to content

RWKV v2 - RNN with Transformer Performance

Compare
Choose a tag to compare
@BlinkDL BlinkDL released this 25 Mar 17:20
· 610 commits to main since this release

Attached model : ctx1024-layer6-emb512 on enwik8 with 1.65 dev perplexity (0.72 BPC)