Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Autoregressive Language Modeling on Wikitext-103
Loading...
18.5
PPL
Hybrid H3
18.112
20.731
23.35
25.969
Nov 8, 2023
PPL
Updated 3d ago
Evaluation Results
Method
Method
Links
PPL
Hybrid H3
Model Size=GPT-2 small...
2023.11
18.5
Hyena-slim
Model Size=GPT-2 small...
2023.11
18.5
Transformer
Model Size=GPT-2 small...
2023.11
18.6
Hyena
Model Size=GPT-2 small...
2023.11
18.6
HGRN
Model Size=GPT-2 small...
2023.11
18.6
Reformer
Model Size=GPT-2 small...
2023.11
25.6
Linear Attention
Model Size=GPT-2 small...
2023.11
25.6
Performer
Model Size=GPT-2 small...
2023.11
26.8
AFT-conv
Model Size=GPT-2 small...
2023.11
28.2
Feedback
Search any
task
Search any
task