Training Efficiency Measurement on Llama 3.1-8B Base (S=512, B200)
3.1Peak Memory Usage (GiB)
AdaLomo
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.06 | 3.1 | 584.9 | |
2026.06 | 3.9 | 229.7 | |
2026.06 | 4.2 | 232.7 | |
2026.06 | 4.2 | 249.4 | |
2026.06 | 4.6 | 221.5 | |
2026.06 | 5.1 | 181.5 | |
2026.06 | 6.2 | 248.6 | |
2026.06 | 6.7 | 186.9 | |
2026.06 | 6.9 | 614.3 | |
2026.06 | 7.2 | 188.4 | |
2026.06 | 9.4 | 267.3 | |
2026.06 | 9.8 | 246 | |
2026.06 | 10.4 | 220.6 | |
2026.06 | 10.7 | 180.6 | |
2026.06 | 11 | 242.4 | |
2026.06 | 12.1 | 905.6 | |
2026.06 | 15 | 255.9 | |
2026.06 | 18 | 192.1 | |
2026.06 | 19.1 | 274.2 | |
2026.06 | 20 | 150.5 | |
2026.06 | 20.1 | 347.2 | |
2026.06 | 21.3 | 222.1 | |
2026.06 | 22.6 | 311.3 | |
2026.06 | 23.5 | 708 | |
2026.06 | 23.5 | 708 | |
2026.06 | 24.4 | 299.7 | |
2026.06 | 25.2 | 946.7 | |
2026.06 | 33.5 | 293.3 | |
2026.06 | 35.8 | 172.6 | |
2026.06 | 35.8 | 172.6 | |
2026.06 | 37.2 | 242.1 | |
2026.06 | 37.2 | 242.1 | |
2026.06 | 37.6 | 222 | |
2026.06 | 38.3 | 279.5 | |
2026.06 | 38.3 | 279.5 | |
2026.06 | 38.9 | 269.2 | |
2026.06 | 40 | 332.8 | |
2026.06 | 40.1 | 237.4 | |
2026.06 | 42.2 | 218.7 | |
2026.06 | 42.2 | 218.7 | |
2026.06 | 43.4 | 268.7 | |
2026.06 | 45.3 | 364.6 | |
2026.06 | 45.3 | 364.6 | |
2026.06 | 46.2 | 251 | |
2026.06 | 46.2 | 397.2 | |
2026.06 | 64.5 | 240.6 | |
2026.06 | 64.5 | - | |
2026.06 | 64.5 | 240.6 | |
2026.06 | 65.9 | 300.1 | |
2026.06 | 75 | 205.2 | |
2026.06 | 75 | 205.2 | |
2026.06 | 76.5 | 252.6 | |
2026.06 | 76.6 | 344.4 | |
2026.06 | 83.6 | 555.3 | |
2026.06 | 89.9 | 240.1 | |
2026.06 | 89.9 | 240.1 | |
2026.06 | 91.8 | 283.9 | |
2026.06 | 137.8 | 226.3 |