Long-context sequences
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| End-to-end Time-to-First-Token (TTFT) | Long-context sequences | TTFT (ms)257 | 36 | |
| Efficiency Evaluation | Long-context sequences 8K to 60K | Avg TTFT14.85 | 12 |
Showing 2 of 2 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| End-to-end Time-to-First-Token (TTFT) | Long-context sequences | TTFT (ms)257 | 36 | |
| Efficiency Evaluation | Long-context sequences 8K to 60K | Avg TTFT14.85 | 12 |