LLM Generation Throughput (End-to-end generation)
751Throughput (tokens/s)
STAR-KV
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.06 | 751 | 3.01 | |
2026.06 | 400.7 | 3.07 | |
2026.06 | 249.8 | - | |
2026.06 | 212.2 | 3.07 | |
2026.06 | 130.4 | - | |
2026.06 | 110.6 | 3.11 | |
2026.06 | 69 | - | |
2026.06 | 56.6 | 3.14 | |
2026.06 | 35.6 | - | |
2026.06 | 18 | - |