Share your thoughts, 1 month free Claude Pro on usSee more

Summarization on XSum (PRR)

0.617PRR

TAD

Updated 1mo ago

Evaluation Results

Method	Links
TAD 2024.08		0.617
LookBackLens 2024.08		0.593
TAD 2024.08		0.55
LookBackLens 2024.08		0.528
Sheeps 2024.08		0.523
Sheeps 2024.08		0.51
SATRMD 2024.08		0.506
SATRMD 2024.08		0.494
TAD 2024.08		0.46
MIND 2024.08		0.437
LookBackLens 2024.08		0.436
MIND 2024.08		0.428
CCP 2024.08		0.399
SAPLMA 2024.08		0.395
Sheeps 2024.08		0.361
Perplexity 2024.08		0.353
Mean Token Entropy 2024.08		0.342
CCP 2024.08		0.339
SATRMD 2024.08		0.338
Perplexity 2024.08		0.325
MSP 2024.08		0.321
Mean Token Entropy 2024.08		0.312
Focus 2024.08		0.31
MSP 2024.08		0.303
Factoscope 2024.08		0.292
SAPLMA 2024.08		0.288
Focus 2024.08		0.266
Simple Focus 2024.08		0.254
Simple Focus 2024.08		0.248
SAPLMA 2024.08		0.245
CCP 2024.08		0.24
Perplexity 2024.08		0.237
Factoscope 2024.08		0.234
Mean Token Entropy 2024.08		0.233
LUQ 2024.08		0.228
MIND 2024.08		0.22
Focus 2024.08		0.209
LUQ 2024.08		0.197
Factoscope 2024.08		0.185
Semantic Density 2024.08		0.172
Semantic Density 2024.08		0.163
EVL NLI Score entail. 2024.08		0.139
DegMat NLI Score entail. 2024.08		0.138
LUQ 2024.08		0.137
SAR 2024.08		0.128
Lexical Similarity Rouge-L 2024.08		0.122
Simple Focus 2024.08		0.109
SAR 2024.08		0.086
Semantic Density 2024.08		0.08
MSP 2024.08		0.077
EigenScore 2024.08		0.077
Lexical Similarity Rouge-L 2024.08		0.076
Lexical Similarity Rouge-L 2024.08		0.059
EVL NLI Score entail. 2024.08		0.058
DegMat NLI Score entail. 2024.08		0.058
SAR 2024.08		0.052
EigenScore 2024.08		0.033
EVL NLI Score entail. 2024.08		0.033
DegMat NLI Score entail. 2024.08		0.031
EigenScore 2024.08		0.024
Semantic Entropy 2024.08		0.016
Semantic Entropy 2024.08		0.016
Ecc. NLI Score entail. 2024.08		0.012
Semantic Entropy 2024.08		0.011
Ecc. NLI Score entail. 2024.08		0.004
Ecc. NLI Score entail. 2024.08		-0.047