Time to First Token (TTFT) measurement on Context sequences 32K-256K (vLLM 0.18.0/0.20.0)
2.944TTFT (Dense, s)
Qwen3.5-9B (distilled indexer)
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| 2.944 | 2.747 | 1.07 | ||
| 5.957 | 4.613 | 1.29 | ||
| 6.863 | 6.024 | 1.14 | ||
| 11.78 | 9.173 | 1.28 | ||
| 17.652 | 12.452 | 1.42 | ||
| 17.928 | 10.491 | 1.71 | ||
| 50.915 | 26.322 | 1.93 |