Throughput and Latency Evaluation on MT-Bench
24.1Throughput (TPS)
MoE-SpAc
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.02 | 24.1 | 22.26 | |
2026.02 | 17.58 | 29.03 | |
2026.02 | 14.34 | 36.08 | |
2026.02 | 12.03 | 43.47 | |
2026.02 | 7.89 | 66.89 | |
2026.02 | 4.46 | 111.34 | |
2026.02 | 3.64 | 136.84 | |
2026.02 | 2.67 | 187.88 | |
2026.02 | 2.36 | 212.7 | |
2026.02 | 1.15 | 435.55 |