Time-to-first-token (TTFT) on Llama 8B Instruct 64K input length 3.1
7.2TTFT (s)
TriangleMix + FlexPrefill
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.07 | 7.2 | |
2025.07 | 7.7 | |
2025.07 | 7.7 | |
2025.07 | 7.7 | |
2025.07 | 8.6 | |
2025.07 | 8.7 | |
2025.07 | 9.4 | |
2025.07 | 10.1 | |
2025.07 | 11.2 |