Our new X account is live! Follow @wizwand_team for updates

Text Summarization on Gigaword (test)

46.99ROUGE-1

EncDec+DOC

Updated 4d ago

Evaluation Results

Method
EncDec+DOC 2018.08	46.99	25.29	43.83	-	-
EncDec+DOC 2018.08	46.91	24.91	43.73	-	-
SEASS 2018.08	46.86	24.58	43.53	-	-
EncDec 2018.08	46.77	24.87	43.58	-	-
Kiyono et al. 2018.08	46.34	24.85	43.49	-	-
BART 2021.01	39.34	20.07	41.25	-	-
PEGASUS 2022.05	39.12	19.86	36.24	-	-
T5 2021.01	38.83	19.68	40.76	-	-
ProphetNet 2021.01	38.49	18.41	39.84	-	-
Liu & Pan 2017.04	38.22	18.7	35.74	-	-
BERT2BERT 2021.01	38.16	18.89	40.06	-	-
Soft Monotonic Attention 2017.04	38.03	18.57	35.7	-	-
ABS 2018.08	37.41	15.87	34.7	-	-
FTSumg 2017.11	37.27	17.65	34.24	-	-
Hard Monotonic Attention 2017.04	37.14	18	34.87	-	-
RNN+Attn 2021.01	36.32	17.63	38.36	-	-
Suzuki & Nagata 2017.04	36.3	17.31	33.88	-	-
Transformer 2021.01	36.21	17.64	38.1	-	-
SEASS 2017.04	36.15	17.54	33.63	-	-
FTSumc 2017.11	35.73	16.02	34.13	-	-
SEASS 2017.04	35.48	16.5	32.93	-	-
words-lvt5k-1sent 2016.02	35.3	16.64	32.62	-	-
Yu et al. 2016a 2017.04	34.41	16.86	31.83	-	-
s2s+att 2017.11	34.23	15.52	31.57	-	-
Nallapati et al. 2017.04	34.19	16.29	32.13	-	-
Miao & Blunsom 2017.04	34.17	15.94	31.92	-	-
s2s+att 2017.04	34.04	15.95	31.68	-	-
RAS-Elman 2016.02	33.78	15.97	31.15	-	-
Chopra et al. 2017.04	33.78	15.97	31.15	-	-
CAs2s 2017.04	33.78	15.97	31.15	-	-
RAS-Elman 2017.11	33.78	15.97	31.15	-	-
NACC (length control) 2022.05	33.66	13.73	31.79	-	4.74
s2s+att 2017.04	33.18	14.79	30.8	-	-
NACC (truncate) 2022.05	33.12	13.93	31.34	-	1.34
CAs2s 2017.04	33.1	14.45	30.25	-	-
Luong-NMT 2017.04	33.1	14.45	30.71	-	-
Luong-NMT 2017.11	33.1	14.45	30.71	-	-
words-lvt2k-1sent 2016.02	32.67	15.59	30.64	74.57	-
Feats2s 2017.04	32.67	15.59	30.64	-	-
Feats2s 2017.11	32.67	15.59	30.64	-	-
Su et al. (truncate) 2022.05	32.28	14.21	30.56	-	0
Qi et al. (truncate) 2022.05	31.69	12.52	30.05	-	-2.79
ABS+ 2015.09	31	12.65	28.34	91.5	-
ABS 2015.09	30.88	12.22	27.77	85.4	-
Yu et al. 2016b 2017.04	30.27	13.68	27.91	-	-
ABS+ 2016.02	29.78	11.89	26.97	91.5	-
ABS+ 2017.11	29.78	11.89	26.97	-	-
Rush et al. 2017.04	29.76	11.88	26.96	-	-
ABS+ 2017.04	29.76	11.88	26.96	-	-
ABS 2017.04	29.55	11.32	26.42	-	-
ABS 2017.11	29.55	11.32	26.42	-	-
Yang et al. (truncate) 2022.05	28.85	6.45	27	-	-14.75
MOSES+ 2015.09	28.77	12.1	26.44	70.5	-
CITESTitle 2022.05	27.87	10.43	24.56	-	-
Zeng et al. 2017.04	27.82	12.74	26.01	-	-
NACC (length control) 2022.05	27.45	8.87	25.14	-	5.19
NACC (truncate) 2022.05	25.79	8.94	23.75	-	2.21
TED 2022.05	25.58	8.94	22.83	-	-
SEQ³ 2022.05	25.39	8.21	22.68	-	-
Char-constrained search 2022.05	25.3	9.25	23.43	-	1.71
BART-LB 2022.05	25.14	8.72	22.35	-	-
Schumann et al. (truncate) 2022.05	24.98	9.08	23.18	-	0.97
CITES 2022.05	24.75	8.42	21.84	-	-
Su et al. (truncate) 2022.05	24.65	8.64	22.98	-	0
Qi et al. (truncate) 2022.05	24.31	7.66	22.48	-	-1.82
T5-LB 2022.05	24	8.19	21.62	-	-
PEGASUS 2022.05	23.39	7.59	20.2	-	-
PREFIX 2015.09	23.14	8.25	21.73	100	-
BART 2022.05	22.07	7.47	20.02	-	-
Yang et al. (truncate) 2022.05	21.7	4.6	20.13	-	-9.84
Brief 2022.05	21.26	5.6	18.89	-	-
Lead-50 chars 2022.05	20.66	7.08	19.3	-	-9.23
COMPRESS 2015.09	19.63	5.13	18.28	100	-
IR 2015.09	16.91	5.55	15.58	29.2	-
T5 2022.05	15.67	4.86	14.38	-	-
REFERENCE 2015.09	-	-	-	45.6	-