Time-to-first-token (TTFT) on Llama 8B Instruct 48K input length 3.1
5.2TTFT (s)
TriangleMix + FlexPrefill
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.07 | 5.2 | |
2025.07 | 5.5 | |
2025.07 | 5.5 | |
2025.07 | 5.8 | |
2025.07 | 5.9 | |
2025.07 | 6 | |
2025.07 | 6.6 | |
2025.07 | 7.3 | |
2025.07 | 7.8 |