| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| C4 | Adam (Stable-SPAM) | Perplexity13.3 | 47 | 12d ago | |
| C4 | SCALE | Perplexity15.57 | 16 | 12d ago | |
| FineWeb-Edu (val) | mHC | BPB0.861 | 8 | 3mo ago | |
| FineWeb-Edu (train) | mHC | Training Loss2.964 | 8 | 3mo ago | |
| C4 (Final val) | SoftMuon | Perplexity18.288 | 5 | 1d ago | |
| PleIAs SYNTH (val) | ALPHALAB + Opus 4.6 | BPB (Validation)0.7578 | 5 | 1mo ago | |
| 500-shard corpus (val) | Opus | Validation BPB0.758 | 3 | 1mo ago | |
| MLPerf C4 | MXFP4 + H16 | Train step throughput20 | 1 | 21d ago |
