Our new X account is live! Follow @wizwand_team for updates

Summarization on PubMed (test)

61.99ROUGE-1

ORACLE

Updated 4d ago

Evaluation Results

Method
ORACLE 2021.07	61.99	34.95	56.76
Oracle 2022.11	61.99	34.95	56.76
ORACLE 2022.10	61.49	34.7	55.92
Top Down Transformer 2022.03	55.15	26.55	50.25
ORACLE 2022.03	53.04	29.08	48.31
ORACLE 2022.03	52.8	28.95	48.08
Top-down (AdaP) 2022.09	51.1	23.3	46.5
Top Down Transformer 2022.03	51.05	23.26	46.47
BART-LS 2022.09	50.3	24.3	46.3
LongT5 2021.12	50.23	24.76	46.67
LongT5-xl 2022.09	50.2	24.8	46.7
LongT5-large 2022.09	50	24.7	46.5
LongT5 2021.12	49.98	24.69	46.46
GoSum 2022.11	49.83	23.56	45.1
ORACLE 2022.03	49.73	27.29	45.26
Lodoss-full-LG 2022.10	49.38	23.89	44.84
MemSum 2021.07	49.25	22.94	44.42
MemSum 2022.11	49.25	22.94	44.42
Lodoss-full 2022.10	48.93	23.51	44.4
Topic-GraphSum 2022.11	48.85	21.76	35.19
Lodoss-joint 2022.10	48.83	23.13	44.23
HAT-BART 2021.12	48.36	21.43	37
HAT 2022.11	48.36	21.43	37
HAT-BART 2021.04	48.36	21.43	37
Transformer-BART 2021.04	48.35	21.43	36.9
Top Down Transformer 2022.03	48.34	21.4	44.22
Top-down (AvgP) 2022.09	48.3	21.4	44.2
HAT 2022.10	48.25	21.35	36.69
PageSum 2022.09	48.2	21.1	44.3
HEROS 2022.11	48.14	21.82	43.33
LSH 2022.03	48.12	21.06	42.72
Hepos-LSH 2021.07	48.12	21.06	42.72
Hepos-LSH 2022.11	48.12	21.06	42.72
LSH 2021.04	48.12	21.06	42.72
Lodoss-base 2022.10	48.1	22.53	43.51
BART-Hepos 2022.09	48.1	21.1	42.7
LoBART(4k)+MCS 2021.05	48.06	20.96	43.56
Hepos-Sinkhorn 2021.07	47.93	20.74	42.58
Hepos-Sinkhorn 2022.11	47.93	20.74	42.58
LoBART(4k) 2021.05	47.47	20.47	43.02
NeuSum 2021.07	47.46	21.92	42.87
NeuSum 2022.11	47.46	21.92	42.87
LED 2022.09	47	20.2	42.9
Longformer 2022.03	46.97	20.23	42.88
SSN-DM 2022.03	46.73	21	34.1
HEROS w/o content ranking 2022.11	46.63	20.63	42.01
HiStruct+ 2022.03	46.59	20.39	42.11
BART(1k)+MCS 2021.05	46.49	19.45	42.04
HiStruct+ 2022.03	46.49	20.29	42.02
HiStruct+ 2022.03	46.38	20.17	41.92
DANCER 2021.05	46.34	19.97	42.42
Dancer 2022.03	46.34	19.97	42.42
Dancer 2021.07	46.34	19.97	42.42
DANCER PEGASUS 2022.03	46.34	19.97	42.42
DANCER PEGASUS 2021.12	46.34	19.97	42.42
Dancer 2022.11	46.34	19.97	42.42
BigBird(3k) 2021.05	46.32	20.65	42.33
BigBird 2022.03	46.32	20.65	42.33
BigBird 2021.07	46.32	20.65	42.33
BigBird PEGASUS 2022.03	46.32	20.65	42.33
BigBird-PEGASUS 2021.12	46.32	20.65	42.33
BigBird-large 2022.10	46.32	20.65	42.33
BigBird-large 2022.11	46.32	20.65	42.33
BigBird 2021.04	46.32	20.65	42.33
BigBird 2022.09	46.3	20.7	42.3
Pegasus 2021.05	45.97	20.15	41.34
PEGASUS 2021.07	45.97	20.15	41.34
PEGASUS 2022.11	45.97	20.15	41.34
PEGASUS 2021.04	45.97	20.15	41.34
HiStruct+ 2022.03	45.76	19.64	41.34
HiStruct+ 2022.03	45.67	19.6	41.26
PEGASUS 2022.03	45.49	19.9	42.42
MMR-Select+ 2022.03	45.39	20.37	40.99
ExtSum-LG + RdLoss 2022.10	45.39	20.37	40.99
ExtSum-LG+Rd 2021.05	45.3	20.42	40.95
RLoss 2022.03	45.3	20.42	40.95
Local-Global + RdLoss 2022.11	45.3	20.42	40.95
Local-Global 2022.11	45.18	20.2	40.72
BART(1k) 2021.05	45.06	18.27	40.84
Sent-CLF 2021.07	45.01	19.91	41.16
Sent-CLF 2022.03	45.01	19.91	41.16
Sent-PTR 2022.10	45.01	19.91	41.16
Sent-CLF 2022.11	45.01	19.91	41.16
Atten-Cont 2021.07	44.85	19.7	31.43
ExtSum-LG 2022.10	44.85	19.7	31.43
Pegasus 2022.03	44.21	16.95	38.83
SummaRuNNer 2021.07	43.89	18.78	30.36
BigBird-base 2022.10	43.7	19.32	39.99
BigBird-base 2022.11	43.7	19.32	39.99
Sent-PTR 2021.07	43.3	17.92	39.47
Sent-PTR 2022.03	43.3	17.92	39.47
Sent-PTR 2022.11	43.3	17.92	39.47
Ext+TLM 2021.05	42.13	16.27	39.21
TLM-I+E 2022.03	42.13	16.27	39.21
TLM-I+E(G,M) 2022.03	42.13	16.27	39.21
TLM-I+E 2022.10	42.13	16.27	39.21
Longformer-base 2022.03	41.69	15.76	37.48
Longformer-large 2022.03	41.69	15.79	37.49
LexRank 2022.10	39.19	13.89	34.59
Discourse-Aware 2021.05	38.93	15.37	35.21

Showing 100 of 107 rows