Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Language Modeling on PG19 T5 (val)
Loading...
15.31
PPLX
Primer
15.2668
15.5584
15.85
16.1416
Sep 17, 2021
PPLX
Speedup
Updated 4d ago
Evaluation Results
Method
Method
Links
PPLX
Speedup
Primer
Params=110M, Steps=920...
2021.09
15.31
1.81
Primer-EZ
Params=110M, Steps=896...
2021.09
15.37
1.98
Transformer++
Params=110M, Steps=998...
2021.09
15.64
1.2
Vanilla Transformer
Params=110M, Steps=1M,...
2021.09
15.83
-
Transformer+GELU
Params=110M, Steps=998...
2021.09
15.84
0.95
Primer-EZ
Params=110M, Steps=471...
2021.09
15.84
1.74
Primer
Params=110M, Steps=483...
2021.09
15.96
1.68
Transformer++
Params=110M, Steps=524...
2021.09
16.15
1.18
Transformer+GELU
Params=110M, Steps=524...
2021.09
16.35
1.01
Vanilla Transformer
Params=110M, Steps=525...
2021.09
16.39
-
Feedback
Search any
task
Search any
task