SOTA Speculative Decoding on Pre-training dataset and PapersWithCode

0.658Speculative Accept %

Full Knowledge Distillation

Updated 3d ago

Evaluation Results

Method	Links
Full Knowledge Distillation 2025.03		0.658
Random Sampling KD 2025.03		0.657
Cross-Entropy 2025.03		0.646