Throughput Evaluation on vLLM
6,622.4Throughput
ThinKV
Updated 23d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.10 | 6,622.4 | |
2025.10 | 4,883.3 | |
2025.10 | 346.9 | |
2025.10 | 331.9 | |
2025.10 | 228.5 |
ThinKV
| Method | Links | |
|---|---|---|
2025.10 | 6,622.4 | |
2025.10 | 4,883.3 | |
2025.10 | 346.9 | |
2025.10 | 331.9 | |
2025.10 | 228.5 |