Language Modeling on Fineweb 100B
12.29Perplexity (PPL)
PathB4-MoE
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.03 | 12.29 | |
2026.03 | 12.53 | |
2026.03 | 12.91 | |
2026.03 | 12.92 | |
2026.03 | 12.92 | |
2026.03 | 12.98 | |
2026.03 | 13.21 | |
2026.03 | 13.34 | |
2026.03 | 16.14 |
PathB4-MoE
| Method | Links | |
|---|---|---|
2026.03 | 12.29 | |
2026.03 | 12.53 | |
2026.03 | 12.91 | |
2026.03 | 12.92 | |
2026.03 | 12.92 | |
2026.03 | 12.98 | |
2026.03 | 13.21 | |
2026.03 | 13.34 | |
2026.03 | 16.14 |