Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Abstractive Meeting Summarization on QMSum
Loading...
1.67
Coreference
Llama
0.162
0.5535
0.945
1.3365
Feb 18, 2025
Coreference
Hallucination
Incoherence
Irrelevance
Language Quality
Omission
Repetition
Structure
ROUGE-1
ROUGE-2
ROUGE-L
BS F1
Updated 4d ago
Evaluation Results
Method
Method
Links
Coreference
Hallucination
Incoherence
Irrelevance
Language Quality
Omission
Repetition
Structure
ROUGE-1
ROUGE-2
ROUGE-L
BS F1
Llama
Zero-shot=true
2025.02
1.67
2.08
1.88
1.52
1.5
3.47
1.19
1.69
40.91
9.79
27.95
62.28
Gemini
Zero-shot=true
2025.02
1.58
2.04
1.09
1.32
1.44
3.38
0.98
1.7
39.61
11.1
27.55
60.64
DeepSeek
Zero-shot=true
2025.02
0.42
1.88
1.85
1.48
1.44
3.36
1.01
1.65
32.37
5.8
18.46
59.44
GPT
Zero-shot=true
2025.02
0.22
3.22
1.5
2.7
1.3
3.4
1.05
0.9
37.73
7.95
21.39
61.61
Feedback
Search any
task
Search any
task
