Our new X account is live! Follow @wizwand_team for updates

Speculative Decoding on Fineweb-edu 1.0 (test)

0.735Speculative Accept Rate

Random Sampling KD (Ours 12+)

Updated 4d ago

Evaluation Results

Method	Links
Random Sampling KD (Ours 12+) 2025.03		0.735
FullKD 2025.03		0.734
Random Sampling KD (Ours 12) 2025.03		0.732
Top-K 50 2025.03		0.731
Top-K 12 2025.03		0.73
CE 2025.03		0.711