Multi-path Speculative Decoding on Average across models (Qwen, Gemma, Llama) (test)
16.69Throughput (tokens/s)
SpecInfer NDE
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.02 | 16.69 | |
2026.02 | 16.4 | |
2026.02 | 16.18 | |
2026.02 | 15.89 | |
2026.02 | 15.05 | |
2026.02 | 14.83 |