Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language Modeling on OpenWebText (dev)
Loading...
18.32
Perplexity (Dev)
GELU
18.2884
18.5017
18.715
18.9283
Jun 30, 2026
Perplexity (Dev)
Updated 24d ago
Evaluation Results
Method
Method
Links
Perplexity (Dev)
GELU
Epoch=2, Number of lay...
2026.06
18.32
NC-FFN
Epoch=2, Number of lay...
2026.06
18.36
GELU
Epoch=1, Number of lay...
2026.06
19
NC-FFN
Epoch=1, Number of lay...
2026.06
19.11
Feedback
Search any
task
Search any
task
