Share your thoughts, 1 month free Claude Pro on usSee more

Selective Generation on TruthfulQA

0.744ROC-AUC

TAD

Updated 1mo ago

Evaluation Results

Method	Links
TAD 2024.08		0.744
LookBackLens 2024.08		0.739
TAD 2024.08		0.738
Sheeps 2024.08		0.736
MIND 2024.08		0.729
TAD 2024.08		0.726
SAPLMA 2024.08		0.725
LookBackLens 2024.08		0.718
LookBackLens 2024.08		0.716
Sheeps 2024.08		0.703
MIND 2024.08		0.696
SATRMD 2024.08		0.694
Sheeps 2024.08		0.687
SAPLMA 2024.08		0.68
MIND 2024.08		0.68
Semantic Density 2024.08		0.68
SATRMD 2024.08		0.679
LUQ 2024.08		0.663
LUQ 2024.08		0.657
Mean Token Entropy 2024.08		0.652
EVL NLI Score entail. 2024.08		0.648
Mean Token Entropy 2024.08		0.648
DegMat NLI Score entail. 2024.08		0.642
Perplexity 2024.08		0.641
Focus 2024.08		0.641
Semantic Density 2024.08		0.634
SATRMD 2024.08		0.622
Mean Token Entropy 2024.08		0.622
SAR 2024.08		0.621
Focus 2024.08		0.619
Perplexity 2024.08		0.617
Perplexity 2024.08		0.616
SAR 2024.08		0.615
EVL NLI Score entail. 2024.08		0.614
Simple Focus 2024.08		0.613
MSP 2024.08		0.612
Semantic Density 2024.08		0.612
DegMat NLI Score entail. 2024.08		0.608
DegMat NLI Score entail. 2024.08		0.606
EVL NLI Score entail. 2024.08		0.605
SAPLMA 2024.08		0.603
Focus 2024.08		0.597
Simple Focus 2024.08		0.588
Lexical Similarity Rouge-L 2024.08		0.583
LUQ 2024.08		0.58
Ecc. NLI Score entail. 2024.08		0.579
Simple Focus 2024.08		0.565
Ecc. NLI Score entail. 2024.08		0.565
SAR 2024.08		0.564
Ecc. NLI Score entail. 2024.08		0.559
Lexical Similarity Rouge-L 2024.08		0.557
CCP 2024.08		0.556
MSP 2024.08		0.55
EigenScore 2024.08		0.55
Factoscope 2024.08		0.546
Factoscope 2024.08		0.541
Semantic Entropy 2024.08		0.538
Factoscope 2024.08		0.537
EigenScore 2024.08		0.537
Semantic Entropy 2024.08		0.529
Lexical Similarity Rouge-L 2024.08		0.525
CCP 2024.08		0.52
EigenScore 2024.08		0.502
Semantic Entropy 2024.08		0.496
MSP 2024.08		0.463
CCP 2024.08		0.452