Share your thoughts, 1 month free Claude Pro on usSee more

Query-based meeting summarization on QMSum (test)

19.63ROUGE-2

Oracle

Updated 1mo ago

Evaluation Results

Method	Links
Oracle 2023.05		19.63	43.8	39.1	-	-	-	-	-
SecEnc-W 2022.09		13.4	37.8	33.4	-	-	-	-	-
SecEnc 2022.09		13	37.1	32.6	-	-	-	-	-
Ranker-Generator 2023.05		12.23	35.51	31.28	-	-	-	-	-
Block-BART 2022.09		12.1	36.6	32.4	-	-	-	-	-
BART-LS 2022.09		12.1	37.9	33.1	-	-	-	-	-
RELREG 2023.05		11.91	34.91	30.73	-	-	-	-	-
Longformer 2023.05		10.32	34.18	29.95	-	-	-	-	-
LED 2022.09		10.3	34.2	30	-	-	-	-	-
RELREG-TT 2023.05		10.17	33.02	28.9	-	-	-	-	-
RankSUM(w/o re-ranking) 2023.05		9.73	33.02	29.15	-	-	-	-	-
DYLE 2023.05		9.71	34.42	30.1	-	-	-	-	-
DYLE 2022.09		9.7	34.4	30.1	-	-	-	-	-
LEAD + BART 2023.05		9.67	32.06	27.93	-	-	-	-	-
Simulator-Generator 2023.05		9.46	32.92	28.93	-	-	-	-	-
DialogLM 2023.05		9.32	33.69	30.01	-	-	-	-	-
SUMMN 2023.05		9.28	34.03	29.48	-	-	-	-	-
DialogLM 2022.09		9.2	34	30	-	-	-	-	-
HMNet 2023.05		8.67	32.29	28.17	-	-	-	-	-
Pointer Network + BART 2023.05		8.53	31.74	28.21	-	-	-	-	-
Locator-Generator 2023.05		8.53	31.47	28.21	-	-	-	-	-
Pointer Network + PGNet 2023.05		8.47	31.37	27.08	-	-	-	-	-
BART-large 2022.09		8	32.2	27.7	-	-	-	-	-
RaptorRAG 2025.02		6.68	-	-	20.38	4.17	81.64	84.57	83.07
HippoRAG2 2025.02		6.6	-	-	21.35	4.01	81.44	84.63	83
BART 2023.05		6.37	29.2	25.49	-	-	-	-	-
Integration 2025.02		6.34	-	-	21.97	3.8	80.89	84.47	82.63
RAG 2025.02		6.32	-	-	21.5	3.8	81.03	84.45	82.69
PGNet 2023.05		5.98	28.74	25.13	-	-	-	-	-
Community-GraphRAG (Local) 2025.02		5.64	-	-	20.54	3.35	80.63	84.13	82.34
KG-GraphRAG (Triplets+Text) 2025.02		5.38	-	-	16.83	3.32	80.92	83.64	82.25
KG-GraphRAG (Triplets only) 2025.02		4.15	-	-	13.71	2.55	80.16	82.96	81.52
Community-GraphRAG (Global) 2025.02		3.23	-	-	10.54	1.97	79.79	82.47	81.1
TextRank 2023.05		2.69	16.27	15.41	-	-	-	-	-