Confidence calibration

Benchmarks

Dataset Name	SOTA Method	Metric
MACE (test)	SCA	AUROC81.2	84	3mo ago
dermatology		Confidence Calibration Error0.013	66	2mo ago
CIFAR-100-LT (test)	Knowledge-Transferring-based Temperature Scaling	ECE0.015	53	3mo ago
vehicle	IRP	Calibration Error0.001	44	2mo ago
glass	IRP	Calibration Error0.008	44	2mo ago
car	Dirichlet Calibration	Calibration Error1.1	44	2mo ago
Pubmed	CaGCN	ECE0.0308	36	3mo ago
Citeseer	GATS	ECE3.86	36	3mo ago
Cora	CaGCN	ECE0.0313	36	3mo ago
CoraFull	CaGCN	ECE0.0701	28	3mo ago
SimpleQA	Probe (train on TriviaQA)	Brier Score0.0386	27	3mo ago
cleveland	IRP	Calibration Error0.03	22	2mo ago
balance-scale	IRP	Calibration Error0.006	22	2mo ago
ReClor (test)	ORCE	ECE4.4	21	21d ago
LogiQA (out-of-distribution)	ADVICE w/ ConfTuner	ECE8	18	1mo ago
MMLU out-of-distribution	ADVICE	ECE5.6	18	1mo ago
TriviaQA (in-domain)	ADVICE w/ ConfTuner	Expected Calibration Error (ECE)3.4	18	1mo ago
Average of four domains Relational Inference Planning	first-second-distance-based (FSD)	Brier Score0.114	18	3mo ago
MultiNLI Mismatch (test)	MIR	ECE0.0071	16	3mo ago
SciQ (test)	Self-Consistency	ECE1.5	15	1mo ago
BeyondAIME (test)	Qwen3-4B-Instruct-ppo-value	SNR Gain1.202	15	3mo ago
iNaturalist 2021	PTSK + PROCAL	ECE0.65	12	3mo ago
Qwen3-4B Calibration		Brier Delta0	10	14d ago
FMNIST ID (test)	OTIS	ECE3.26	9	3mo ago
MNIST ID (test)	CEDA	ECE0.14	9	3mo ago

Showing 25 of 41 rows