Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Language Modeling on WikiText-103 small setting (val)
Loading...
31.8
Perplexity
Delta RNN
31.588
33.019
34.45
35.881
Jun 11, 2021
Perplexity
Updated 4d ago
Evaluation Results
Method
Method
Links
Perplexity
Delta RNN
Slow net=Feedforward,...
2021.06
31.8
RDN
Slow net=Recurrent, Up...
2021.06
32.5
Delta LSTM
Slow net=Feedforward,...
2021.06
32.6
Transformer
Context truncation=256...
2021.06
33
Delta RNN
Slow net=Feedforward,...
2021.06
33.8
Delta Delta Net
Slow net=Feedforward,...
2021.06
34
Delta Net
Slow net=Feedforward,...
2021.06
34.1
RDN
Slow net=Recurrent, Up...
2021.06
34.1
Delta MLP
Slow net=Feedforward,...
2021.06
35.8
Linear Transformer
Slow net=Feedforward,...
2021.06
37.1
Feedback
Search any
task
Search any
task