Throughput Benchmarking on vLLM (1k Input / 1k Output Tokens)
2.42Throughput (req/s)
Fisher-MoE
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.06 | 2.42 | 4,853.52 | 2.1 | 1.21 | |
2026.06 | 2.01 | 4,010.27 | 1.74 | 1 | |
2026.06 | 1.15 | 2,298.89 | 1 | 0.57 |
Fisher-MoE
| Method | Links | ||||
|---|---|---|---|---|---|
2026.06 | 2.42 | 4,853.52 | 2.1 | 1.21 | |
2026.06 | 2.01 | 4,010.27 | 1.74 | 1 | |
2026.06 | 1.15 | 2,298.89 | 1 | 0.57 |