Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Summary Conciseness Evaluation on REALSumm
Loading...
0.505
Pearson Correlation (Summary Level)
FineSurE
0.06924
0.18237
0.2955
0.40863
Jul 1, 2024
Pearson Correlation (Summary Level)
Spearman Correlation (Summary Level)
System Rank Score
Updated 4d ago
Evaluation Results
Method
Method
Links
Pearson Correlation (Summary Level)
Spearman Correlation (Summary Level)
System Rank Score
FineSurE
Direction=LLM-based, B...
2024.07
0.505
0.451
0.88
FineSurE
Direction=LLM-based, B...
2024.07
0.438
0.399
0.911
BERTScore
Direction=Similarity-b...
2024.07
0.416
0.405
0.783
ROUGE-1
Direction=Similarity-b...
2024.07
0.387
0.371
0.332
ROUGE-2
Direction=Similarity-b...
2024.07
0.328
0.337
0.29
G-Eval
Direction=LLM-based, B...
2024.07
0.314
0.277
0.582
ROUGE-L
Direction=Similarity-b...
2024.07
0.31
0.321
0.083
BARTScore
Direction=Similarity-b...
2024.07
0.241
0.21
0.824
UniEval
Direction=QA-based
2024.07
0.086
0.128
-0.176
Feedback
Search any
task
Search any
task
