Multi-turn Dialogue on MT-Bench (Token/s and Speedup)
270.96Tokens/s
EVICT
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 270.96 | - | |
2026.05 | 254.83 | - | |
2026.05 | 221.97 | - | |
2026.05 | 213.12 | - | |
2026.05 | 212.33 | - | |
2026.05 | 203.17 | - | |
2026.05 | 190.34 | - | |
2026.05 | 180.18 | - | |
2026.05 | 174.57 | - | |
2026.05 | 171.08 | - | |
2026.05 | 170.29 | - | |
2026.05 | 162.26 | - | |
2026.05 | 159.16 | - | |
2026.05 | 152.31 | - | |
2026.05 | 143.1 | - | |
2026.05 | 140.13 | - | |
2026.05 | 133.59 | - | |
2026.05 | 129.01 | - | |
2026.05 | 101.59 | - | |
2026.05 | 99 | - |