Speculative Decoding Efficiency on CNN/DM, GSM8K, TinyStories Aggregate
28.26Decoding Speed (tokens/s)
SWIFT
Updated 5mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.02 | 28.26 | 1.41 | |
2026.02 | 28.05 | 1.4 | |
2026.02 | 26.8 | 1.34 | |
2026.02 | 26.21 | 1.31 | |
2026.02 | 25.69 | 1.29 | |
2026.02 | 25.46 | 1.27 | |
2026.02 | 20.1 | 1 | |
2026.02 | 19.96 | 1 | |
2026.02 | 19.49 | 0.97 | |
2026.02 | 19.26 | 0.97 | |
2026.02 | 6.41 | 1.48 | |
2026.02 | 6.29 | 1.46 | |
2026.02 | 5.45 | 1.26 | |
2026.02 | 4.32 | 1 | |
2026.02 | 4.14 | 0.96 |