Share your thoughts, 1 month free Claude Pro on usSee more

Model Calibration on Fineweb-edu 1.0 (test)

0.002ECE

Random Sampling KD (Ours 12)

Updated 22d ago

Evaluation Results

Method	Links
Random Sampling KD (Ours 12) 2025.03		0.002
FullKD 2025.03		0.002
CE 2025.03		0.003
Random Sampling KD (Ours 12+) 2025.03		0.017
Top-K 50 2025.03		0.018
Top-K 12 2025.03		0.047
LMSI 2026.07		0.095
N-OPSD 2026.07		0.177
TTRL 2026.07		0.178
N-OPSD 2026.07		0.191
Qwen3-4B base 2026.07		0.246
TTRL 2026.07		0.248
LMSI 2026.07		0.255