Multi-path speculative decoding on Llama (held-out test)
1.21Throughput Ratio Improvement
NaiveTree NDE
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.02 | 1.21 | |
2026.02 | 0.97 | |
2026.02 | 0.96 | |
2026.02 | 0.96 | |
2026.02 | 0.96 |
NaiveTree NDE
| Method | Links | |
|---|---|---|
2026.02 | 1.21 | |
2026.02 | 0.97 | |
2026.02 | 0.96 | |
2026.02 | 0.96 | |
2026.02 | 0.96 |