Share your thoughts, 1 month free Claude Pro on usSee more

Uncertainty Estimation on APPS Intro

0.813AUROC

Top-5 Entropy (LEX)

Updated 1mo ago

Evaluation Results

Method
Top-5 Entropy (LEX) 2026.06	0.813	0.828
Top-5 Entropy (LEX) 2026.06	0.813	0.828
Top-5 Entropy (LEX) 2026.06	0.807	0.822
Pseudo Consistency (ALGO) 2026.06	0.803	0.704
Pseudo Consistency (ALGO) 2026.06	0.803	0.704
Consistency (VR) 2026.06	0.799	0.843
Top-5 + Tests + Pseudo 2026.06	0.796	0.852
Top-5 + Tests + Pseudo 2026.06	0.792	0.87
Top-5 + Tests + Pseudo 2026.06	0.792	0.87
Max Entropy 2026.06	0.78	0.806
Consistency (VR) 2026.06	0.776	0.798
Consistency (VR) 2026.06	0.776	0.798
Symb. Clustering 2026.06	0.764	0.813
Symb. Clustering 2026.06	0.764	0.813
Consistency (VR) 2026.06	0.759	0.797
Consistency (VR) 2026.06	0.759	0.797
Top-5 + Tests + Pseudo 2026.06	0.759	0.884
Top-5 + Tests + Pseudo 2026.06	0.752	0.739
Top-5 + Tests + Pseudo 2026.06	0.752	0.739
Top-5 + Tests + Pseudo 2026.06	0.749	0.814
Top-5 + Tests + Pseudo 2026.06	0.749	0.814
Generated Tests (FUNC) 2026.06	0.749	0.809
Generated Tests (FUNC) 2026.06	0.747	0.748
Generated Tests (FUNC) 2026.06	0.747	0.748
Generated Tests (FUNC) 2026.06	0.745	0.787
Consistency (VR) 2026.06	0.745	0.737
Generated Tests (FUNC) 2026.06	0.745	0.787
Consistency (VR) 2026.06	0.745	0.737
Generated Tests (FUNC) 2026.06	0.743	0.804
Consistency (BLEU) 2026.06	0.742	0.776
Consistency (BLEU) 2026.06	0.742	0.776
Consistency (BLEU) 2026.06	0.739	0.797
Consistency (BLEU) 2026.06	0.736	0.781
Max Entropy 2026.06	0.724	0.767
Consistency (BLEU) 2026.06	0.721	0.767
Consistency (BLEU) 2026.06	0.721	0.767
Pseudo Consistency (ALGO) 2026.06	0.721	0.838
Max Probability 2026.06	0.72	0.718
Mean Probability 2026.06	0.716	0.751
Pseudo Consistency (ALGO) 2026.06	0.713	0.833
Pseudo Consistency (ALGO) 2026.06	0.713	0.833
Generated Tests (FUNC) 2026.06	0.708	0.763
Generated Tests (FUNC) 2026.06	0.708	0.763
Top-5 Entropy (LEX) 2026.06	0.701	0.651
Top-5 Entropy (LEX) 2026.06	0.701	0.651
Mean Entropy 2026.06	0.694	0.7
Mean Entropy 2026.06	0.694	0.7
Pseudo Consistency (ALGO) 2026.06	0.691	0.802
Pseudo Consistency (ALGO) 2026.06	0.691	0.802
Consistency (VR) 2026.06	0.689	0.733
Pseudo Consistency (ALGO) 2026.06	0.671	0.753
Mean Entropy 2026.06	0.67	0.71
Symb. Clustering 2026.06	0.665	0.776
Top-5 Entropy (LEX) 2026.06	0.637	0.668
Top-5 Entropy (LEX) 2026.06	0.637	0.668
Max Probability 2026.06	0.633	0.692
Consistency (BLEU) 2026.06	0.614	0.624
Consistency (BLEU) 2026.06	0.614	0.624
Mean Probability 2026.06	0.612	0.659
Symb. Clustering 2026.06	0.612	0.697
Top-5 Entropy (LEX) 2026.06	0.573	0.644
Symb. Clustering 2026.06	0.566	0.643
Symb. Clustering 2026.06	0.566	0.643
Mean Probability 2026.06	0.515	0.512
Max Probability 2026.06	0.51	0.53
Max Entropy 2026.06	0.508	0.469
Max Probability 2026.06	0.504	0.51
Max Entropy 2026.06	0.503	0.534
Mean Probability 2026.06	0.499	0.528
Mean Entropy 2026.06	0.491	0.461
Mean Entropy 2026.06	0.491	0.461
Symb. Clustering 2026.06	0.484	0.506
Symb. Clustering 2026.06	0.484	0.506
Mean Entropy 2026.06	0.483	0.532
Mean Entropy 2026.06	0.483	0.532
Mean Probability 2026.06	0.469	0.602
Max Probability 2026.06	0.467	0.605
Max Entropy 2026.06	0.46	0.559
Mean Entropy 2026.06	0.45	0.561