Language Model Pre-training on C4 Llama-1B scratch (val)
2.638Validation Loss
SF-AdamW
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.12 | 2.638 | |
2025.12 | 2.638 | |
2025.12 | 2.638 | |
2025.12 | 2.638 | |
2025.12 | 2.645 | |
2025.12 | 2.6553 | |
2025.12 | 2.6558 | |
2025.12 | 2.6572 | |
2025.12 | 2.6577 | |
2025.12 | 2.6602 | |
2025.12 | 2.6639 | |
2025.12 | 2.6737 | |
2025.12 | 2.6749 | |
2025.12 | 2.6749 | |
2025.12 | 2.6749 | |
2025.12 | 2.6749 |