Uncertainty Estimation

Benchmarks

Dataset Name	SOTA Method	Metric
TriviaQA	Geometry-Calibrated Conformal Abstention	AUROC88	129	1mo ago
TriviaQA (test)	ACT-ViT	AUROC87.91	110	1mo ago
MBPP	Top-5 + Tests + Pseudo	AUROC0.791	79	1mo ago
HumanEval	Top-5 + Tests + Pseudo	AUROC0.886	79	1mo ago
APPS Interview	Top-5 + Tests + Pseudo	AUROC81	79	1mo ago
APPS Intro	Top-5 Entropy (LEX)	AUROC0.813	79	1mo ago
JudgeBench (test)	Energy	AUROC71.53	77	4mo ago
AOKVQA	Visual Semantic Entropy	AUC79.8	65	24d ago
CoQA	Logit Magnitude	AUROC0.857	58	2mo ago
SciQA	Eigenscore	AUROC0.8269	56	3mo ago
FaceForensics++ (test)	Evidential DL	Pearson Correlation (ρ)0.475	44	1mo ago
emrQA	Logit Magnitude	AUROC77.5	42	2mo ago
NewsQA	Self-Consistency	AUROC76.6	42	2mo ago
TruthfulQA	Internal Confidence	PRR26.8	42	1mo ago
CoQA (test)	SAR	AUROC77.3	42	4mo ago
GSM8K	BSDETECTOR	AUROC0.951	41	2mo ago
NaturalQA	SAR	AUROC77	39	2mo ago
Real-Noise	Deep Ens.	Uncertainty Interval Length0.021	36	2mo ago
Secret-word taboo dataset (random-split)	Bootstrap	Accuracy42.4	32	2mo ago
NQ-open	SE+MCH	AUROC75.88	32	3mo ago
Gaussian noise dataset	Deep Ens.	Uncertainty Interval Length0.05	30	2mo ago
Poisson noise dataset	QUTCC	Uncertainty Interval Length0.035	30	2mo ago
WebQA	SE + MARS	AUROC73.57	30	4mo ago
OBQA	DeepEns	AUROC88.03	24	3mo ago
RACE Llama-3.1-8B and Gemma-2-9B backbones (test)	ETN	AUROC91.3	24	3mo ago

Showing 25 of 108 rows