Multi-path Speculative Decoding on Gemma (test)
13.26Throughput (tokens/s)
SpecInfer NDE
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.02 | 13.26 | |
2026.02 | 13.22 | |
2026.02 | 12.86 | |
2026.02 | 12.84 | |
2026.02 | 12.4 | |
2026.02 | 11.56 |
SpecInfer NDE
| Method | Links | |
|---|---|---|
2026.02 | 13.26 | |
2026.02 | 13.22 | |
2026.02 | 12.86 | |
2026.02 | 12.84 | |
2026.02 | 12.4 | |
2026.02 | 11.56 |