SOTA Abstractive Summarization benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
SAMSum	LEARNED SWA	ROUGE-228.97	73	3mo ago
Gigaword (test)	OFA	ROUGE-139.81	58	3mo ago
CNN/Daily Mail non-anonymous (test)	BART_LARGE	ROUGE-144.16	52	3mo ago
CNN/DailyMail full length F-1 (test)	DCA MLE+SEM+RL, mpgen, with-comm, with caa (m7)	ROUGE-141.69	48	3mo ago
Multi-News	PRIMER	ROUGE-221.1	47	3mo ago
XSUM (test)	BRIO-Mul	ROUGE-L40.4	44	3mo ago
XLSum	mT5-small (Student)	ROUGE-L49.1	34	1mo ago
Gigawords (test)	Risk	ROUGE-136.96	27	3mo ago
WikiHow	PEGASUS_LARGE	ROUGE-222.12	26	3mo ago
CNN/DailyMail	BART + RD	ROUGE-144.51	25	3mo ago
XSum	T5-large	ROUGE-140.67	22	2mo ago
CNN/DailyMail Summarization	Bayes (ours)	Hamming Distance1.597	20	3mo ago
XL-Sum (test)	xLLMs-100	Language Democratization67.21	20	2mo ago
arXiv (test)	Claude Instant + SigExt	R-153.7	20	3mo ago
MeetingBank (test)	CriSPO	ROUGE-L F-score54.1	18	3mo ago
AESLC	PEGASUS_LARGE	ROUGE-L36.51	18	3mo ago
How2 (test)	Multi-source Sequence-to-Sequence Model with Hierarchical Attention	Content F148.9	18	3mo ago
New York Times (test)	BRIO-Mul	ROUGE-157.75	18	3mo ago
LongLaMP Abs	SpecSteer	ROUGE-143.91	16	2mo ago
XSum (val)	G-XKD	ROUGE-20.1624	16	3mo ago
CNNDM full (test)	Z-Code++ Large	ROUGE-142	16	3mo ago
Annotated English Gigaword (test)	B2T connection	ROUGE-139.61	15	3mo ago
XL-Sum Ukrainian (test)	Gemma 3 12B PT	BLEU Score6.52	14	21d ago
CNN/DM	SummScore - LEAD-3	ROUGE-142.05	14	3mo ago
XSum	Transformer++	XSum Score17.9	14	3mo ago

Showing 25 of 111 rows