Time-to-first-token (TTFT) on Llama-3.1-8B-Instruct 80K input length
9.2TTFT (s)
TriangleMix + FlexPrefill
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.07 | 9.2 | |
2025.07 | 9.5 | |
2025.07 | 9.9 | |
2025.07 | 10 | |
2025.07 | 11.7 | |
2025.07 | 11.7 | |
2025.07 | 12.3 | |
2025.07 | 12.4 | |
2025.07 | 15.9 |