Share your thoughts, 1 month free Claude Pro on usSee more

Correctness Prediction on TriviaQA

0.852AUROC

Assessor

Updated 18d ago

Evaluation Results

Method	Links
Assessor 2025.09		0.852
Assessor 2025.09		0.846
Direction 2025.09		0.826
Probe(AVG) 2025.08		0.818
Probe(EOS) 2025.08		0.812
Probe(EOS) 2025.08		0.81
Assessor 2025.09		0.807
LogProb 2025.08		0.806
Direction 2025.09		0.804
Direction 2025.09		0.796
Prob(Exact) 2025.08		0.796
Assessor 2025.09		0.79
Assessor 2025.09		0.789
Probe(AVG) 2025.08		0.786
Prob(Exact) 2025.08		0.783
Prob(Exact) 2025.08		0.781
LogProb 2025.08		0.774
LogProb 2025.08		0.774
LogTokU 2025.08		0.773
Probe(AVG) 2025.08		0.765
Assessor 2025.09		0.759
Direction 2025.09		0.758
Probe(EU) 2025.08		0.754
Probe(EU) 2025.08		0.751
Probe(EU) 2025.08		0.751
Probe(EOS) 2025.08		0.739
P(true) 2025.08		0.736
Direction 2025.09		0.735
Direction 2025.09		0.734
P(True) 2026.03		0.69
LogTokU 2025.08		0.683
P(true) 2025.08		0.672
Verb. conf. 2025.09		0.643
P(true) 2025.08		0.631
Verb. conf. 2025.09		0.619
LogTokU 2025.08		0.611
Epi. & Alea. 2026.03		0.61
Aleatoric 2026.03		0.6
Verb. conf. 2025.09		0.58
Verb. conf. 2025.09		0.57
Sem. Entropy 2026.03		0.55
Naïve Entropy 2026.03		0.52
Epistemic 2026.03		0.52
Verb. conf. 2025.09		0.515
Verb. conf. 2025.09		0.502