Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Generation on MBPP (Accepted length (τ))
Loading...
5.26
Accepted Length (τ)
DSpark
3.6272
4.0511
4.475
4.8989
Jul 6, 2026
Accepted Length (τ)
Updated 18d ago
Evaluation Results
Method
Method
Links
Accepted Length (τ)
DSpark
target_model=Qwen3-14B
2026.07
5.26
DSpark
target_model=Qwen3-8B
2026.07
5.16
DSpark
target_model=Qwen3-4B
2026.07
5.13
DSpark
target_model=Gemma4-12B
2026.07
5.11
Eagle3
target_model=Gemma4-12B
2026.07
4.72
DFlash
target_model=Qwen3-14B
2026.07
4.44
DFlash
target_model=Qwen3-4B
2026.07
4.4
DFlash
target_model=Gemma4-12B
2026.07
4.39
DFlash
target_model=Qwen3-8B
2026.07
4.36
Eagle3
target_model=Qwen3-8B
2026.07
3.96
Eagle3
target_model=Qwen3-14B
2026.07
3.81
Eagle3
target_model=Qwen3-4B
2026.07
3.69
Feedback
Search any
task
Search any
task
