Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Abstractive Meeting Summarization on FAME [GER]
Loading...
1.38
Coreference
GPT
1.368
1.449
1.53
1.611
Feb 18, 2025
Coreference
Hallucination
Incoherence
Irrelevance
Language Quality
Omission
Repetition
Structure
ROUGE-1
ROUGE-2
ROUGE-L
BERTScore (F1)
Updated 4d ago
Evaluation Results
Method
Method
Links
Coreference
Hallucination
Incoherence
Irrelevance
Language Quality
Omission
Repetition
Structure
ROUGE-1
ROUGE-2
ROUGE-L
BERTScore (F1)
GPT
Zero-shot=true
2025.02
1.38
1.57
1.18
1.16
1.31
4.18
0.52
1.66
33.74
7.45
25.2
64.75
Llama
Zero-shot=true
2025.02
1.52
1.61
1.57
1.27
1.31
4.18
0.47
1.54
32.54
7.24
24.1
64.61
Gemini
Zero-shot=true
2025.02
1.57
1.65
1.39
1.23
0.97
4
0.79
1.42
32.03
6.98
23.59
64.58
DeepSeek
Zero-shot=true
2025.02
1.68
1.81
1.2
1.29
1.04
4.18
0.34
1.5
33.9
7.93
24.6
64.88
Feedback
Search any
task
Search any
task
