Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Text Summarization on XSum (Accept Rate, ROUGE-2)
Loading...
8.38
ROUGE-2
SD (Lossy)
5.2288
6.0469
6.865
7.6831
Apr 8, 2026
ROUGE-2
Accept Rate
Updated 8d ago
Evaluation Results
Method
Method
Links
ROUGE-2
Accept Rate
SD (Lossy)
Target Model=Gemma-3-1...
2026.04
8.38
39.48
Autoregressive
Target Model=Gemma-3-1...
2026.04
8.31
-
SD
Target Model=Gemma-3-1...
2026.04
8.27
35.76
SpecCascade
Target Model=Gemma-3-1...
2026.04
8.27
39.42
Static Ensemble
Target Model=Gemma-3-1...
2026.04
7.9
61.42
DIVERSED
Target Model=Gemma-3-1...
2026.04
7.22
63.38
Diversed
Target Model=Qwen3-8B,...
2026.04
5.54
38.12
Static Ensemble
Target Model=Qwen3-8B,...
2026.04
5.39
34.14
Autoregressive
Target Model=Qwen3-8B,...
2026.04
5.38
-
SD
Target Model=Qwen3-8B,...
2026.04
5.35
19.56
Feedback
Search any
task
Search any
task