Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Generation on MBPP (Speedup, Average Acceptance Length (τ))
Loading...
4
Speedup
DEER
1.088
1.844
2.6
3.356
Dec 17, 2025
Speedup
Avg Acceptance Length (τ)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Speedup
Avg Acceptance Length (τ)
DEER
Base Model=Qwen3-30B-A...
2025.12
4
4.87
DEER
Base Model=Qwen3-14B,...
2025.12
3.18
5.28
DEER
Base Model=Qwen3-8B, T...
2025.12
3
5.12
DEER
Base Model=Qwen3-4B, T...
2025.12
2.86
4.91
EAGLE3
Base Model=Qwen3-4B, T...
2025.12
2.59
3.37
EAGLE3
Base Model=Qwen3-8B, T...
2025.12
2.59
3.31
EAGLE3
Base Model=Qwen3-14B,...
2025.12
2.5
3.52
DEER
Base Model=Qwen2-7B, T...
2025.12
2.45
3.57
Hydra
Base Model=Qwen3-8B, T...
2025.12
2.37
2.79
EAGLE3
Base Model=Qwen2-7B, T...
2025.12
2.36
3.32
Hydra
Base Model=Qwen3-4B, T...
2025.12
2.33
2.7
EAGLE3
Base Model=Qwen3-30B-A...
2025.12
2.22
3.07
MEDUSA
Base Model=Qwen3-8B, T...
2025.12
1.29
1.93
MEDUSA
Base Model=Qwen3-4B, T...
2025.12
1.2
2.07
Feedback
Search any
task
Search any
task
