Language Modeling on Fineweb-edu 1.0 (test)
2.32LM Loss
Random Sampling KD (Ours 12+)
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
| 2.32 | ||
2025.03 | 2.34 | |
2025.03 | 2.35 | |
2025.03 | 2.37 | |
2025.03 | 2.4 | |
2025.03 | 2.5 |
Random Sampling KD (Ours 12+)
| Method | Links | |
|---|---|---|
| 2.32 | ||
2025.03 | 2.34 | |
2025.03 | 2.35 | |
2025.03 | 2.37 | |
2025.03 | 2.4 | |
2025.03 | 2.5 |