Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Abstractive Meeting Summarization on FAME EN
Loading...
1.6
Coreference
Llama
1.444
1.4845
1.525
1.5655
Feb 18, 2025
Coreference
Hallucination
Incoherence
Irrelevance
Language Quality
Omission
Repetition
Structure
ROUGE-1
ROUGE-2
ROUGE-L
BERTScore F1
Updated 1mo ago
Evaluation Results
Method
Method
Links
Coreference
Hallucination
Incoherence
Irrelevance
Language Quality
Omission
Repetition
Structure
ROUGE-1
ROUGE-2
ROUGE-L
BERTScore F1
Llama
Zero-shot=true
2025.02
1.6
1.02
1.43
1.42
1.04
4.31
0.51
1.36
40.35
8.62
29.45
63.53
Gemini
Zero-shot=true
2025.02
1.57
1.4
0.72
1.07
1.2
4.31
0.44
1.53
38.82
8.96
27.81
63.66
DeepSeek
Zero-shot=true
2025.02
1.54
1.81
0.94
1.11
1.22
4.48
0.39
1.52
33.18
8.07
23.16
63.16
GPT
Zero-shot=true
2025.02
1.45
0.98
0.94
1.14
1.17
4.16
0.74
1.57
39.68
8.43
29.98
63.8
Feedback
Search any
task
Search any
task
