LLM Inference Efficiency on AIME
40.6Time To First Token (TTFT)
RelayCaching
Updated 2mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.02 | 40.6 | 2.1 | 1.6 | 50 | |
2026.02 | 44.9 | 1.9 | - | - | |
2026.02 | 57 | 3.16 | 2.8 | 60 | |
2026.02 | 73.2 | 4.39 | 4.3 | 70 | |
2026.02 | 76.7 | 2.35 | - | - | |
2026.02 | 85.2 | - | - | - | |
2026.02 | 104.8 | 4.71 | 7.9 | 80 | |
2026.02 | 112.5 | 2.86 | - | - | |
2026.02 | 159.3 | 3.1 | - | - | |
2026.02 | 180.2 | - | - | - | |
2026.02 | 321.5 | - | - | - | |
2026.02 | 493.9 | - | - | - |