Text Generation Speed/Throughput on MT-Bench
4.76Speedup
Hybrid Verified Decoding
Updated 1d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 4.76 | - | |
2026.05 | 4.68 | - | |
2026.05 | 3.34 | - | |
2026.05 | 3.24 | - | |
2026.05 | 2.31 | - | |
2026.05 | 2.06 | - | |
2026.05 | 1.59 | - | |
2026.05 | 1.41 | - | |
2026.05 | 1.21 | - | |
2026.05 | 1.18 | - | |
2026.05 | 1.1 | - | |
2026.05 | 0.99 | - | |
2026.05 | 0.98 | - | |
2026.05 | 0.87 | - | |
2026.05 | - | 80.68 | |
2026.05 | - | 64.73 | |
2026.05 | - | 112.68 | |
2026.05 | - | 107.17 | |
2026.05 | - | 137.81 | |
2026.05 | - | 80.99 | |
2026.05 | - | 63.5 | |
2026.05 | - | 108.28 | |
2026.05 | - | 105.36 | |
2026.05 | - | 134.18 |