Confidence calibration

Benchmarks

Dataset Name	SOTA Method	Metric
MACE (test)	SCA	AUROC81.2	84	4mo ago
dermatology		Confidence Calibration Error0.013	66	4mo ago
CIFAR-100-LT (test)	Knowledge-Transferring-based Temperature Scaling	ECE0.015	53	4mo ago
vehicle	IRP	Calibration Error0.001	44	4mo ago
glass	IRP	Calibration Error0.008	44	4mo ago
car	Dirichlet Calibration	Calibration Error1.1	44	4mo ago
Citeseer	MS	ECE3.1	41	1mo ago
Pubmed	CaGCN	ECE0.0308	36	4mo ago
Cora	CaGCN	ECE0.0313	36	4mo ago
CoraFull	CaGCN	ECE0.0701	28	4mo ago
SimpleQA	Probe (train on TriviaQA)	Brier Score0.0386	27	4mo ago
cleveland	IRP	Calibration Error0.03	22	4mo ago
balance-scale	IRP	Calibration Error0.006	22	4mo ago
ReClor (test)	ORCE	ECE4.4	21	2mo ago
LogiQA (out-of-distribution)	ADVICE w/ ConfTuner	ECE8	18	2mo ago
MMLU out-of-distribution	ADVICE	ECE5.6	18	2mo ago
TriviaQA (in-domain)	ADVICE w/ ConfTuner	Expected Calibration Error (ECE)3.4	18	2mo ago
Average of four domains Relational Inference Planning	first-second-distance-based (FSD)	Brier Score0.114	18	4mo ago
MultiNLI Mismatch (test)	MIR	ECE0.0071	16	4mo ago
SciQ (test)	Self-Consistency	ECE1.5	15	2mo ago
BeyondAIME (test)	Qwen3-4B-Instruct-ppo-value	SNR Gain1.202	15	4mo ago
iNaturalist 2021	PTSK + PROCAL	ECE0.65	12	4mo ago
Qwen3-4B Calibration		Brier Delta0	10	2mo ago
FMNIST ID (test)	OTIS	ECE3.26	9	4mo ago
MNIST ID (test)	CEDA	ECE0.14	9	4mo ago

Showing 25 of 41 rows