Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language Modeling on PG19 T5 (val)
Loading...
15.31
PPLX
Primer
15.2668
15.5584
15.85
16.1416
Sep 17, 2021
PPLX
Speedup
Updated 1mo ago
Evaluation Results
Method
Method
Links
PPLX
Speedup
Primer
Params=110M, Steps=920...
2021.09
15.31
1.81
Primer-EZ
Params=110M, Steps=896...
2021.09
15.37
1.98
Transformer++
Params=110M, Steps=998...
2021.09
15.64
1.2
Vanilla Transformer
Params=110M, Steps=1M,...
2021.09
15.83
-
Transformer+GELU
Params=110M, Steps=998...
2021.09
15.84
0.95
Primer-EZ
Params=110M, Steps=471...
2021.09
15.84
1.74
Primer
Params=110M, Steps=483...
2021.09
15.96
1.68
Transformer++
Params=110M, Steps=524...
2021.09
16.15
1.18
Transformer+GELU
Params=110M, Steps=524...
2021.09
16.35
1.01
Vanilla Transformer
Params=110M, Steps=525...
2021.09
16.39
-
Feedback
Search any
task
Search any
task