Share your thoughts, 1 month free Claude Pro on usSee more

Selective Generation on CoQA (ROC-AUC)

74.7ROC-AUC

TAD

Updated 2mo ago

Evaluation Results

Method	Links
TAD 2024.08		74.7
Sheeps 2024.08		74.6
TAD 2024.08		74.4
Semantic Density 2024.08		73.4
Semantic Density 2024.08		73.1
TAD 2024.08		73
MIND 2024.08		72.2
Semantic Density 2024.08		72
SATRMD 2024.08		71.8
Simple Focus 2024.08		71.2
LookBackLens 2024.08		70.6
EVL NLI Score entail. 2024.08		70.3
Perplexity 2024.08		70.3
SATRMD 2024.08		70.2
LookBackLens 2024.08		70.1
SAR 2024.08		70
LUQ 2024.08		69.9
Simple Focus 2024.08		69.8
DegMat NLI Score entail. 2024.08		69.8
MSP 2024.08		69.8
SATRMD 2024.08		69.7
EVL NLI Score entail. 2024.08		69.7
LookBackLens 2024.08		69.7
SAR 2024.08		69.5
Sheeps 2024.08		69.5
Ecc. NLI Score entail. 2024.08		69.4
DegMat NLI Score entail. 2024.08		69.4
Lexical Similarity Rouge-L 2024.08		69.3
EVL NLI Score entail. 2024.08		69.1
Mean Token Entropy 2024.08		68.9
DegMat NLI Score entail. 2024.08		68.9
Ecc. NLI Score entail. 2024.08		68.5
LUQ 2024.08		68.4
LUQ 2024.08		68.4
Lexical Similarity Rouge-L 2024.08		68.3
SAR 2024.08		68.3
Semantic Entropy 2024.08		67.9
MSP 2024.08		67.8
Ecc. NLI Score entail. 2024.08		67.7
Focus 2024.08		67.6
Lexical Similarity Rouge-L 2024.08		67.5
Perplexity 2024.08		67.4
Semantic Entropy 2024.08		67.3
EigenScore 2024.08		67.3
Simple Focus 2024.08		67.1
EigenScore 2024.08		67
CCP 2024.08		66.9
Mean Token Entropy 2024.08		66.8
Sheeps 2024.08		66.8
Perplexity 2024.08		66.5
Mean Token Entropy 2024.08		66.2
MIND 2024.08		66
EigenScore 2024.08		65.8
MSP 2024.08		65.5
MIND 2024.08		65.4
Semantic Entropy 2024.08		65.3
Focus 2024.08		64.1
CCP 2024.08		63.9
CCP 2024.08		63.3
Focus 2024.08		62.4
Factoscope 2024.08		58.5
Factoscope 2024.08		51.3
SAPLMA 2024.08		50.9
SAPLMA 2024.08		50.1
SAPLMA 2024.08		49.9
Factoscope 2024.08		49.3