SciTLDR
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Model Calibration | SCITLDR (dev) | smECE0.072 | 21 | |
| Confidence Estimation | SCITLDR (dev) | smECE0.08 | 21 | |
| Extreme Summarization | SciTLDR 1.0 (test) | ROUGE-152.4 | 20 | |
| Scientific Extreme Summarization | SciTLDR (test) | ROUGE-147.7 | 14 | |
| Topic-Controlled Summarisation | SciTLDR (test) | BERTScore0.8799 | 11 | |
| Summarization | SciTLDR | BERTScore0.783 | 10 | |
| Summarization | SciTLDR (test) | RL Score35.99 | 10 | |
| Scientific document summarization | SCITLDR (dev) | smECE0.08 | 9 | |
| Abstractive Summarization | SciTLDR AIC | ROUGE-144.9 | 8 | |
| Abstractive Summarization | SciTLDR Abstracts | ROUGE-143.8 | 8 | |
| Abstractive Summarization | SciTLDR Full Text | ROUGE-136.92 | 6 | |
| Text Compression | SciTLDR (test) | ROUGE-1 F144.9 | 4 | |
| Text Summarization | SciTLDR 76 gold papers | MRR0.6 | 4 | |
| Abstractive Summarization | SciTLDR AIC (test) | Mean ROUGE-132.1 | 4 |
Showing 14 of 14 rows