LLM Inference Acceleration on MT-bench
5.5818Mean Accepted Length (tau)
CATS w/ EAGLE
Updated 21d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 5.5818 | 5.58 | |
2026.05 | 5.3499 | 5.28 | |
2026.05 | 5.2409 | 4.52 | |
2026.05 | 5.2004 | 5.2 | |
2026.05 | 5.1051 | 5.05 | |
2026.05 | 5.0634 | 5.06 | |
2026.05 | 4.9756 | 4.29 | |
2026.05 | 4.9609 | 4.28 | |
2026.05 | 4.9133 | 4.87 | |
2026.05 | 4.8191 | 4.75 | |
2026.05 | 4.7199 | 4.07 | |
2026.05 | 4.7032 | 4.68 | |
2026.05 | 4.6991 | 4.68 | |
2026.05 | 4.6181 | 4.62 | |
2026.05 | 4.4699 | 4.42 | |
2026.05 | 4.2752 | 4.24 | |
2026.05 | 4.236 | 4.18 | |
2026.05 | 4.193 | 3.61 | |
2026.05 | 4.1813 | 3.6 | |
2026.05 | 3.9754 | 3.96 | |
2026.05 | 3.9369 | 3.92 | |
2026.05 | 3.6897 | 3.64 | |
2026.05 | 3.5232 | 3.49 | |
2026.05 | 3.2421 | 3.22 | |
2026.05 | 3.0423 | 3.01 | |
2026.05 | 2.8444 | 2.83 | |
2026.05 | 2.7946 | 2.77 | |
2026.05 | 2.7905 | 2.37 | |
2026.05 | 2.7894 | 2.78 | |
2026.05 | 2.5833 | 2.19 | |
2026.05 | 2.4184 | 2.41 | |
2026.05 | 2.3831 | 2.37 | |
2026.05 | 2.0646 | 1.75 | |
2026.05 | 1.9737 | 1.68 | |
2026.05 | 1.8667 | 1.87 | |
2026.05 | 1.7817 | 1.78 |