Multi-path Speculative Decoding on Qwen (test)
22.54Throughput (tokens/s)
SpecInfer NDE
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.02 | 22.54 | |
2026.02 | 21.74 | |
2026.02 | 21.67 | |
2026.02 | 21.35 | |
2026.02 | 20.29 | |
2026.02 | 18.41 |
SpecInfer NDE
| Method | Links | |
|---|---|---|
2026.02 | 22.54 | |
2026.02 | 21.74 | |
2026.02 | 21.67 | |
2026.02 | 21.35 | |
2026.02 | 20.29 | |
2026.02 | 18.41 |