Uncertainty Estimation on GSM8K

0.951AUROC

BSDETECTOR

Updated 1mo ago

Evaluation Results

Method
BSDETECTOR 2023.08	0.951	-	-	-	-
BSDETECTOR 2023.08	0.867	-	-	-	-
Self-reflection Certainty 2023.08	0.831	-	-	-	-
Geometry-Calibrated Conformal Abstention 2026.04	0.78	-	-	-	0.42
SelfCheckGPT 2026.04	0.77	-	-	-	-
Perplexity 2026.04	0.77	-	-	-	0.4
SAR 2026.04	0.73	-	-	-	0.39
Semantic 2026.04	0.73	-	-	-	0.32
Proposed 2026.04	0.68	-	-	-	0.77
Temperature Sampling 2023.08	0.66	-	-	-	-
Eigen 2026.04	0.65	-	-	-	0.31
Likelihood Based Uncertainty 2023.08	0.647	-	-	-	-
Kernel Lang. Ent. 2026.04	0.637	-	-	-	-
SAR 2026.04	0.62	-	-	-	0.7
Temperature Sampling 2023.08	0.614	-	-	-	-
Total 2026.04	0.61	-	-	-	-
Semantic 2026.04	0.61	-	-	-	0.66
Eigen 2026.04	0.61	-	-	-	0.69
Perplexity 2026.04	0.6	-	-	-	0.67
SemanticEntropy 2026.04	0.584	-	-	-	-
ATRMD 2026.04	0.58	-	-	-	0.64
Aleatoric 2026.04	0.577	-	-	-	-
Closeness Centrality 2026.04	0.56	-	-	-	-
Focus 2026.04	0.56	-	-	-	0.2
ATRMD 2026.04	0.56	-	-	-	0.16
SC Based VC 2026.04	0.555	-	-	-	-
SC Score 2026.04	0.551	-	-	-	-
SC + VC 2026.04	0.544	-	-	-	-
Self-reflection Certainty 2023.08	0.521	-	-	-	-
Focus 2026.04	0.52	-	-	-	0.63
Max Sequence Prob. 2026.04	0.496	-	-	-	-
Token Entropy 2026.04	0.465	-	-	-	-
Max Token Prob. 2026.04	0.464	-	-	-	-
Perplexity 2026.04	0.462	-	-	-	-
Mean Token Entropy 2026.04	0.461	-	-	-	-
P(True) 2026.04	0.46	-	-	-	0.14
Attention 2026.04	0.46	-	-	-	0.55
Self Certainty 2026.04	0.459	-	-	-	-
P(True) 2026.04	0.44	-	-	-	0.55
Attention 2026.04	0.39	-	-	-	0.11
PTrue 2026.04	0.371	-	-	-	-
MC 2026.03	-	0.539	0.513	0.54	-
MC 2026.03	-	0.59	0.552	0.595	-
DiSE 2026.03	-	0.633	0.644	0.658	-
LLaMA perplexity 2026.03	-	0.675	0.605	0.577	-
MC 2026.03	-	0.516	0.559	0.525	-
MC 2026.03	-	0.559	0.578	0.608	-
DiSE 2026.03	-	0.61	0.616	0.613	-
LLaMA perplexity 2026.03	-	0.635	0.631	0.546	-