Summarization on CNNDM (test)

37.82ROUGE 2

Oracle (EDUs)

Updated 11d ago

Evaluation Results

Method
Oracle (EDUs) 2026.04	37.82	-	-	-	61.61	59.27
SEASON 2022.10	22.64	-	-	-	46.27	43.08
T5 2022.08	22.6	-	-	-	-	-
CIT + SE 2022.10	22.53	-	-	-	45.8	42.48
GSum 2022.10	22.32	-	-	-	45.94	42.48
Z-Code++_LARGE 2022.08	22.2	-	-	-	-	-
Q-P 2021.05	21.65	4.37	83.84	69.4	44.62	41.47
Q-C-O 2021.05	21.58	2.92	83.08	68.16	44.7	41.53
PEGASUS 2022.10	21.47	-	-	-	44.17	41.11
PEGASUS_LARGE 2022.08	21.4	-	-	-	-	-
Q-C 2021.05	21.37	8.57	84.75	72.83	44.4	41.17
MLE 2021.05	21.35	1.69	82.84	68.33	44.24	41.18
HAHSum 2022.10	21.3	-	-	-	44.68	40.75
BART 2022.10	21.28	-	-	-	44.16	40.9
Q-F1-C 2021.05	21.24	7.79	84.97	70.54	44.23	40.96
BART 2022.10	21.23	-	-	-	44.21	41.17
Longformer with MLP for RST & Coref 2026.04	20.91	-	-	-	43.73	40.72
Q-C-W 2021.05	20.88	7.2	83.54	70.03	44.04	40.74
MatchSum 2022.10	20.86	-	-	-	44.41	40.55
DiscoBERT w RST & Coref 2026.04	20.85	-	-	-	43.77	40.67
DiscoBERT w RST 2026.04	20.71	-	-	-	43.68	40.54
DiscoBERT w Coref 2026.04	20.64	-	-	-	43.58	40.42
DiscoBERT 2026.04	20.44	-	-	-	43.38	40.21
BERTSUMEXT 2026.04	20.24	-	-	-	43.25	39.63
BERTSUMEXTABS 2026.04	19.6	-	-	-	42.13	39.18
BERTSUMABS 2026.04	19.39	-	-	-	41.72	38.76
BART-base 2026.04	18.49	-	-	-	41.44	38.32
R-C 2021.05	18.41	-7.01	79.28	63.5	41.17	37.94
LEAD-3 2022.10	17.7	-	-	-	40.34	36.57
Lead3 2026.04	17.62	-	-	-	40.42	36.67
Point-Generator 2022.10	17.28	-	-	-	39.53	36.38