Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Character-level language modeling on Enwik8 (val)
Loading...
1.04
BPC
Adaptive Transformer
1.0268
1.1159
1.205
1.2941
Sep 8, 2017
Jan 20, 2018
Jun 4, 2018
Oct 17, 2018
Mar 1, 2019
Jul 14, 2019
Nov 26, 2019
BPC
Updated 4d ago
Evaluation Results
Method
Method
Links
BPC
Adaptive Transformer
Layers=12, Heads=96, P...
2019.11
1.04
SHA-LSTM
Layers=4, Heads=4, Par...
2019.11
1.096
SHA-LSTM
Layers=4, Heads=1, Par...
2019.11
1.1
Mogrifier LSTM
Heads=0, Params=48M
2019.11
1.135
LSTM
Heads=0, Params=48M
2019.11
1.182
SRU (with projection)
Size=49m, #layers=12,...
2017.09
1.19
SRU (with projection)
Size=47m, #layers=8, U...
2017.09
1.21
SRU (with projection)
Size=37m, #layers=6, U...
2017.09
1.25
SRU
Size=37m, #layers=10,...
2017.09
1.26
LSTM
Size=46m, #layers=4, U...
2017.09
1.28
SRU
Size=37m, #layers=6, U...
2017.09
1.29
SHA-LSTM
Layers=4, Heads=0, Par...
2019.11
1.312
LSTM
Size=37m, #layers=6, U...
2017.09
1.35
QRNN (k=1)
Size=37m, #layers=6, U...
2017.09
1.36
LSTM
Size=37m, #layers=3, U...
2017.09
1.37
Feedback
Search any
task
Search any
task