Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Summary Conciseness Evaluation on REALSumm
Loading...
0.505
Pearson Correlation (Summary Level)
FineSurE
0.06924
0.18237
0.2955
0.40863
Jul 1, 2024
Pearson Correlation (Summary Level)
Spearman Correlation (Summary Level)
System Rank Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pearson Correlation (Summary Level)
Spearman Correlation (Summary Level)
System Rank Score
FineSurE
Direction=LLM-based, B...
2024.07
0.505
0.451
0.88
FineSurE
Direction=LLM-based, B...
2024.07
0.438
0.399
0.911
BERTScore
Direction=Similarity-b...
2024.07
0.416
0.405
0.783
ROUGE-1
Direction=Similarity-b...
2024.07
0.387
0.371
0.332
ROUGE-2
Direction=Similarity-b...
2024.07
0.328
0.337
0.29
G-Eval
Direction=LLM-based, B...
2024.07
0.314
0.277
0.582
ROUGE-L
Direction=Similarity-b...
2024.07
0.31
0.321
0.083
BARTScore
Direction=Similarity-b...
2024.07
0.241
0.21
0.824
UniEval
Direction=QA-based
2024.07
0.086
0.128
-0.176
Feedback
Search any
task
Search any
task
