Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Long-context Summarization on MultiNews
Loading...
5.97
MAT
Graft
1.6644
2.7822
3.9
5.0178
May 19, 2026
MAT
Inference Speedup
Updated 14d ago
Evaluation Results
Method
Method
Links
MAT
Inference Speedup
Graft
Backbone=LLaMA3.1-8B
2026.05
5.97
3.16
EAGLE3-64K
Backbone=LLaMA3.1-8B
2026.05
5.83
2.85
Graft
Backbone=Qwen3-8B
2026.05
3.5
1.92
EAGLE3-64K
Backbone=Qwen3-8B
2026.05
3.39
1.68
Graft
Backbone=Qwen3-14B
2026.05
3.22
2.08
Graft
Backbone=Qwen3-4B
2026.05
3.07
1.94
EAGLE3-64K
Backbone=Qwen3-14B
2026.05
3.01
1.71
EAGLE3-64K
Backbone=Qwen3-4B
2026.05
2.83
1.55
Triforce
Backbone=LLaMA3.1-8B
2026.05
2.53
1.85
MagicDec
Backbone=LLaMA3.1-8B
2026.05
2.31
0.71
TokenSwift
Backbone=LLaMA3.1-8B
2026.05
1.83
1.62
Feedback
Search any
task
Search any
task