QAGS
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Factual Consistency Evaluation | QAGS-XSum | Spearman Correlation57.4 | 39 | |
| Factual Consistency Evaluation | QAGS CNNDM | Spearman Correlation73.9 | 38 | |
| Factual Consistency Evaluation | QAGS-CNNDM (test) | Pearson Correlation Coefficient78.1 | 22 | |
| Factual Consistency Evaluation | QAGS-XSum (test) | Pearson Correlation Coefficient5.27 | 22 | |
| Factuality Evaluation | QAGS XSUM | Pearson Correlation53.9 | 19 | |
| Factuality Evaluation | QAGS CNN | Pearson Correlation0.735 | 11 | |
| Factual Consistency Evaluation | QAGS-X | Pearson Correlation (rp)0.618 | 5 | |
| Factual Consistency Evaluation | QAGS-C | Pearson Correlation (rp)0.785 | 5 |
Showing 8 of 8 rows