LLM Inference Efficiency on Uniform Sampled Documents
191.7TTFT (ms)
Lazy-Attn
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.06 | 191.7 | 6.2 | |
2026.06 | 274.8 | 4.3 | |
2026.06 | 372.5 | 6.9 | |
2026.06 | 565.3 | 4.5 | |
2026.06 | 675.2 | 6.1 | |
2026.06 | 1,150.6 | 3.6 | |
2026.06 | 1,196.8 | 1 | |
2026.06 | 2,580.4 | 1 | |
2026.06 | 4,150.5 | 1 |