LLM Training on Llama2-70B (64 x H100-8)
7.8Iteration Time (s)
Megatron-LM
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.07 | 7.8 | 47.2 | - | |
2025.07 | 9.2 | 40 | - | |
2025.07 | 9.4 | 39.1 | - | |
2025.07 | 10.6 | 34.7 | - |
Megatron-LM
| Method | Links | |||
|---|---|---|---|---|
2025.07 | 7.8 | 47.2 | - | |
2025.07 | 9.2 | 40 | - | |
2025.07 | 9.4 | 39.1 | - | |
2025.07 | 10.6 | 34.7 | - |