End-to-end Time-to-First-Token (TTFT) on Long-context sequences
257TTFT (ms)
FlashPrefill
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.03 | 257 | 1.04 | |
2026.03 | 267 | - | |
2026.03 | 406 | 1.04 | |
2026.03 | 423 | - | |
2026.03 | 447 | 1.05 | |
2026.03 | 471 | - | |
2026.03 | 519 | 1.18 | |
2026.03 | 613 | - | |
2026.03 | 851 | 1.07 | |
2026.03 | 912 | - | |
2026.03 | 913 | 1.07 | |
2026.03 | 976 | - | |
2026.03 | 1,090 | 1.47 | |
2026.03 | 1,603 | - | |
2026.03 | 1,707 | 1.2 | |
2026.03 | 1,860 | 1.18 | |
2026.03 | 2,048 | - | |
2026.03 | 2,189 | - | |
2026.03 | 2,331 | 1.98 | |
2026.03 | 3,534 | 1.34 | |
2026.03 | 3,618 | 1.49 | |
2026.03 | 4,635 | - | |
2026.03 | 4,735 | - | |
2026.03 | 4,909 | 3.1 | |
2026.03 | 5,398 | - | |
2026.03 | 7,323 | 1.72 | |
2026.03 | 7,481 | 1.97 | |
2026.03 | 10,702 | 5.02 | |
2026.03 | 12,563 | - | |
2026.03 | 14,774 | - | |
2026.03 | 15,061 | 3.02 | |
2026.03 | 15,203 | - | |
2026.03 | 15,213 | 2.45 | |
2026.03 | 37,239 | - | |
2026.03 | 45,464 | - | |
2026.03 | 53,752 | - |