Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Character-level Language Modeling on enwik8 (train)
Loading...
0.72
BPC
RWKV-RNN
0.686
0.9155
1.145
1.3745
Jul 25, 2020
Jan 12, 2021
Jul 3, 2021
Dec 22, 2021
Jun 12, 2022
Dec 1, 2022
May 22, 2023
BPC
Updated 4d ago
Evaluation Results
Method
Method
Links
BPC
RWKV-RNN
L=6, d=512, T=1024, Ti...
2023.05
0.72
Transformer
L=12, d=512, T=1024, T...
2023.05
0.977
Linear Transformer
L=12, d=512, T=1024, T...
2023.05
0.981
Synthesizer
L=12, d=512, T=1024, T...
2023.05
0.994
Performer
L=12, d=512, T=1024, T...
2023.05
1.002
RWKV-RNN
L=12, d=512, T=1024, T...
2023.05
1.01
Transformer
L=24, d=256, T=1024, T...
2023.05
1.039
Reformer
L=12, d=512, T=1024, T...
2023.05
1.04
AFT-simple
L=12, d=512, T=1024, T...
2023.05
1.046
Late-phase Rank1
Number of units=500, S...
2020.07
1.522
Base + Rank1
Number of units=500, S...
2020.07
1.524
Base LSTM
Number of units=500, S...
2020.07
1.57
Feedback
Search any
task
Search any
task