Speculative Decoding on Fineweb-edu distillation 8B to 300M
62Spec. Accept %
Random Sampling KD
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.03 | 62 | |
2025.03 | 62 | |
2025.03 | 61.9 | |
2025.03 | 61.9 | |
2025.03 | 61.5 | |
2025.03 | 61 | |
2025.03 | 60 |
Random Sampling KD
| Method | Links | |
|---|---|---|
2025.03 | 62 | |
2025.03 | 62 | |
2025.03 | 61.9 | |
2025.03 | 61.9 | |
2025.03 | 61.5 | |
2025.03 | 61 | |
2025.03 | 60 |