DUC
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Text Summarization | DUC 2004 (test) | ROUGE-138.57 | 115 | |
| Summarization | DUC 2002 (test) | ROUGE-147.6 | 18 | |
| Multi-document Query Focused Summarization | DUC 2006 | ROUGE-146.64 | 11 | |
| Keyphrase extraction | DUC 2001 | F1 Score @ 527.39 | 9 | |
| Multi-document summarization | DUC 2004 (test) | ROUGE-1 Score36.42 | 9 | |
| Present Keyphrase Generation | DUC 2001 | F1 Score @ 320 | 8 | |
| Multi-document summarization | DUC 2007 (test) | ROUGE-143.426 | 8 | |
| Multi-Document Summarization | DUC 2007 250 (test) | ROUGE-135.3 | 6 | |
| Sentence Compression | DUC 2004 | ROUGE-1 Recall27.41 | 6 | |
| Summarization | DUC 75-byte limit 2004 | ROUGE-1 Recall32.28 | 6 | |
| Multi-document Summarization | DUC 2007 (human evaluation) | Informativeness65.5 | 3 | |
| Summarization | DUC 2007 20 examples (test) | Grammaticality4.7 | 3 | |
| Summarization | DUC 2007 (test) | Sr12.5 | 3 | |
| Multi-document Query Focused Summarization | DUC 2007 | ROUGE-147.91 | 3 | |
| Multi-document Query Focused Summarization | DUC 2005 | ROUGE-143.48 | 3 | |
| Absent Keyphrase Generation | DUC 2001 | R@50 | 1 |
Showing 16 of 16 rows