SOTA Abstractive Summarization benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
SAMSum	LEARNED SWA	ROUGE-228.97	73	1mo ago
Gigaword (test)	OFA	ROUGE-139.81	58	1mo ago
CNN/Daily Mail non-anonymous (test)	BART_LARGE	ROUGE-144.16	52	1mo ago
CNN/DailyMail full length F-1 (test)	DCA MLE+SEM+RL, mpgen, with-comm, with caa (m7)	ROUGE-141.69	48	1mo ago
Multi-News	PRIMER	ROUGE-221.1	47	1mo ago
XSUM (test)	BRIO-Mul	ROUGE-L40.4	44	1mo ago
XLSum	mT5-small (Student)	ROUGE-L49.1	34	12d ago
Gigawords (test)	Risk	ROUGE-136.96	27	1mo ago
WikiHow	PEGASUS_LARGE	ROUGE-222.12	26	1mo ago
CNN/DailyMail	BART + RD	ROUGE-144.51	25	1mo ago
XSum	T5-large	ROUGE-140.67	22	15d ago
CNN/DailyMail Summarization	Bayes (ours)	Hamming Distance1.597	20	1mo ago
XL-Sum (test)	xLLMs-100	Language Democratization67.21	20	1mo ago
arXiv (test)	Claude Instant + SigExt	R-153.7	20	1mo ago
MeetingBank (test)	CriSPO	ROUGE-L F-score54.1	18	1mo ago
AESLC	PEGASUS_LARGE	ROUGE-L36.51	18	1mo ago
How2 (test)	Multi-source Sequence-to-Sequence Model with Hierarchical Attention	Content F148.9	18	1mo ago
New York Times (test)	BRIO-Mul	ROUGE-157.75	18	1mo ago
LongLaMP Abs	SpecSteer	ROUGE-143.91	16	1mo ago
XSum (val)	G-XKD	ROUGE-20.1624	16	1mo ago
CNNDM full (test)	Z-Code++ Large	ROUGE-142	16	1mo ago
Annotated English Gigaword (test)	B2T connection	ROUGE-139.61	15	1mo ago
CNN/DM	SummScore - LEAD-3	ROUGE-142.05	14	1mo ago
XSum	Transformer++	XSum Score17.9	14	1mo ago
Spotify Podcast 2020 (test)	LoBART(4k)	ROUGE-127.81	13	1mo ago

Showing 25 of 98 rows