Our new X account is live! Follow @wizwand_team for updates

Model Calibration on Fineweb-edu 1.0 (test)

0.002ECE

Random Sampling KD (Ours 12)

Updated 4d ago

Evaluation Results

Method	Links
Random Sampling KD (Ours 12) 2025.03		0.002
FullKD 2025.03		0.002
CE 2025.03		0.003
Random Sampling KD (Ours 12+) 2025.03		0.017
Top-K 50 2025.03		0.018
Top-K 12 2025.03		0.047