Share your thoughts, 1 month free Claude Pro on usSee more

Confidence Estimation on SCITLDR (dev)

0.08smECE

HRE

Updated 1mo ago

Evaluation Results

Method	Links
HRE 2026.06		0.08	0.67	0.71	0.92	0.77
NWKR 2026.06		0.08	0.67	0.71	0.92	0.77
ACUTE 2026.06		0.08	0.69	0.72	0.92	0.78
ACUTE 2026.06		0.08	0.7	0.72	0.92	0.78
ACUTE 2026.06		0.08	0.69	0.72	0.92	0.77
ACUTE 2026.06		0.08	0.68	0.71	0.92	0.77
Platt 2026.06		0.082	0.643	0.763	0.94	0.781
Isotonic 2026.06		0.082	0.637	0.763	0.94	0.778
NWKR 2026.06		0.083	0.641	0.763	0.94	0.78
Beta 2026.06		0.083	0.641	0.761	0.94	0.779
ACUTE late act 2026.06		0.087	0.654	0.764	0.94	0.784
HRE 2026.06		0.088	0.637	0.763	0.94	0.779
ACUTE mid act 2026.06		0.088	0.653	0.763	0.94	0.784
ACUTE cosine 2026.06		0.089	0.634	0.76	0.94	0.776
ACUTE early act 2026.06		0.089	0.652	0.763	0.94	0.784
ACUTE 2026.06		0.09	0.7	0.72	0.92	0.78
ACUTE 2026.06		0.09	0.7	0.72	0.92	0.78
ACUTE pca10 2026.06		0.092	0.637	0.762	0.94	0.778
ACUTE pca20 2026.06		0.092	0.653	0.765	0.94	0.785
Raw Conf 2026.06		0.146	0.413	0.76	0.939	0.701
Raw Conf 2026.06		0.15	0.36	0.71	0.92	0.66