Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Summarization on CNN/DM (test) using Tau and SR metrics
Loading...
4.54
Tau
CORAL
3.2296
3.5698
3.91
4.2502
Feb 24, 2025
Tau
Summary Recall
Updated 1mo ago
Evaluation Results
Method
Method
Links
Tau
Summary Recall
CORAL
model=Llama2-7B-chat,...
2025.02
4.54
2.62
HASS
model=Llama2-7B-chat,...
2025.02
4.44
2.57
CORAL
model=Llama3-8B-Instru...
2025.02
4.16
2.2
EAGLE-2
model=Llama2-7B-chat,...
2025.02
4.12
2.4
HASS
model=Llama3-8B-Instru...
2025.02
4.06
2.16
EAGLE-2
model=Llama3-8B-Instru...
2025.02
3.82
1.98
CORAL
model=Qwen2.5-7B-Instr...
2025.02
3.72
1.97
CORAL
model=Llama3-8B-Instru...
2025.02
3.61
2.16
HASS
model=Qwen2.5-7B-Instr...
2025.02
3.57
1.9
EAGLE-2
model=Qwen2.5-7B-Instr...
2025.02
3.33
1.78
CORAL
model=Qwen2.5-7B-Instr...
2025.02
3.28
1.99
Feedback
Search any
task
Search any
task
