Training Stability Analysis on Llama-2 7B pre-training
0Number of Spikes
AdaGC
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2025.02 | 0 | 0 | |
2025.02 | 0 | 0 | |
2025.02 | 1 | 1.11 | |
2025.02 | 3 | 3.33 | |
2025.02 | 3 | 3.33 | |
2025.02 | 3 | 3.33 | |
2025.02 | 8 | 8.89 | |
2025.02 | 8 | 8.89 | |
2025.02 | 9 | 10 |