Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Language Modeling on FineWeb-Edu 300M×5B (val)

23.6PPL

FP16 reference

-44.536415.382875.31,335.218Apr 20, 2026
Updated 1mo ago

Evaluation Results

MethodLinks
2026.04
23.6
2026.04
23.7
2026.04
23.7
2026.04
25.4
2026.04
25.4
2026.04
25.5
2026.04
26
2026.04
26
2026.04
26.1
2026.04
39.9
2026.04
57.6
2026.04
58.1
2026.04
119
2026.04
671
2026.04
1,727