Our new X account is live! Follow @wizwand_team for updates

Character level language modeling on enwik8 (dev)

1BPC

Adaptive

Updated 4d ago

Evaluation Results

Method	Links
Adaptive 2019.05		1
Transformer-LS 2021.07		1.01
Longformer 2020.04		1.02
Longformer 2021.07		1.02
Adaptive 2019.05		1.04
Adaptive 2020.04		1.04
Adaptive 2021.07		1.04
Adaptive Attention Span 2023.11		1.04
Skip Cross-Head Transformer-XL 2023.11		1.058
Skip Cross-Head Transformer-XL 2023.11		1.06