Share your thoughts, 1 month free Claude Pro on usSee more

Confidence Estimation on DocILE (full)

0.928AUC

EXTRACTCONF

Updated 1mo ago

Evaluation Results

Method	Links
EXTRACTCONF 2026.06		0.928	0.974	0.199	0.237	0.136	0.043	91.4
EXTRACTCONF 2026.06		0.928	0.974	0.048	0.028	0.094	0.042	91.9
EXTRACTCONF 2026.06		0.926	0.973	0.034	0.028	0.094	0.044	91.6
All except Mapper 2026.06		0.911	0.967	0.184	0.223	0.141	0.065	89
OCR only 2026.06		0.896	0.949	0.197	0.219	0.141	0.079	89.6
Logprobs + Entropy 2026.06		0.88	0.953	0.18	0.261	0.162	0.076	87.6
Agreement only 2026.06		0.828	0.902	0.207	0.283	0.186	0.102	87.5
Spatial only 2026.06		0.814	0.897	0.258	0.34	0.22	0.103	86.5
Self-Consistency 2026.06		0.744	0.852	0.075	0.072	0.183	0.138	86
Logprob Mean 2026.06		0.705	0.864	0.245	0.245	0.253	0.145	84.6
Verbalized Conf. 2026.06		0.692	0.828	0.163	0.163	0.213	0.146	84.6