| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| SummaC | ALIGN | CGS88.4 | 52 | 4d ago | |
| QAGS-XSum | ALIGN-large | Spearman Correlation57.4 | 39 | 3d ago | |
| QAGS CNNDM | ALIGNSCORE-large | Spearman Correlation73.9 | 38 | 3d ago | |
| TRUE benchmark | ALIGNSCORE-large | PAWS (AUC-ROC)98.4 | 37 | 4d ago | |
| SummEval | ALIGNSCORE-large | Spearman Correlation46.6 | 36 | 3d ago | |
| SAMSum | ALIGN | Spearman Correlation46.7 | 30 | 3d ago | |
| FRANK CNNDM | ALIGN | Spearman Correlation61.8 | 30 | 3d ago | |
| FRANK-XSum (FRK-X) | DAE | Spearman Correlation32.1 | 30 | 3d ago | |
| SSum | ALIGNSCORE-large | Kendall's Tau35.8 | 22 | 4d ago | |
| FRK-C | ALIGNSCORE-large | Kendall's Tau48.5 | 22 | 4d ago | |
| FRK-X | DAE | Kendall's Tau32.1 | 22 | 4d ago | |
| Q-C | ALIGNSCORE-large | Kendall's Tau61.3 | 22 | 4d ago | |
| Q-X | ALIGNSCORE-large | Kendall's tau46.8 | 22 | 4d ago | |
| SE | ALIGNSCORE-large | Kendall's Tau37.4 | 22 | 4d ago | |
| XSF | DAE | Kendall's Tau38.6 | 22 | 4d ago | |
| XSum-Faithful (XSF) | DAE | Spearman Correlation47 | 22 | 3d ago | |
| SamSum (test) | ALIGNSCORE-large | Pearson Correlation Coefficient44.6 | 22 | 4d ago | |
| FRANK CNNDM (test) | ALIGNSCORE-large | PCC67.7 | 22 | 4d ago | |
| FRANK-XSum (test) | ALIGNSCORE-large | Pearson Correlation Coefficient38.3 | 22 | 4d ago | |
| QAGS-CNNDM (test) | ALIGNSCORE-large | Pearson Correlation Coefficient78.1 | 22 | 4d ago | |
| QAGS-XSum (test) | ALIGNSCORE-large | Pearson Correlation Coefficient5.27 | 22 | 4d ago | |
| SummEval (test) | ALIGNSCORE-large | Pearson CC66.3 | 22 | 4d ago | |
| XSumFaith (test) | DAE | Pearson Correlation Coefficient42.5 | 22 | 4d ago | |
| TRUE 1.0 (test) | Eour | Frank AUC91.5 | 20 | 4d ago | |
| SamSum | ALIGN | Pearson Correlation Coefficient47.7 | 8 | 4d ago |
