Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Abstractive Summarization on XSum (ROUGE-L, Avg)
Loading...
18.87
ROUGE-L
LoRA FP16
17.622
17.946
18.27
18.594
May 22, 2026
ROUGE-L
Average Score
Updated 8d ago
Evaluation Results
Method
Method
Links
ROUGE-L
Average Score
LoRA FP16
Base Model=LLaMA-2-7B,...
2026.05
18.87
28.81
QAT Full (Ours)
Base Model=LLaMA-2-7B,...
2026.05
18.6
28.08
QAT Full (Ours)
Base Model=LLaMA-2-7B,...
2026.05
18.49
25.59
QAT Full (Ours)
Base Model=LLaMA-2-7B,...
2026.05
18.49
28.07
QAT Full (Ours)
Base Model=LLaMA-2-7B,...
2026.05
18.32
24.14
LoRAQuant ρ=0.9
Base Model=LLaMA-2-7B,...
2026.05
18.27
23.17
LoRA FP16 (same-size ref.)
Base Model=LLaMA-2-7B,...
2026.05
18.23
25.53
LoRA FP16 (same-size ref.)
Base Model=LLaMA-2-7B,...
2026.05
17.85
23.21
LoRA FP16 (same-size ref.)
Base Model=LLaMA-2-7B,...
2026.05
17.85
23.21
LoRAQuant ρ=0.5
Base Model=LLaMA-2-7B,...
2026.05
17.67
20.31
Feedback
Search any
task
Search any
task