Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code on MBPP (Speedup/Tau)
Loading...
7.68
Speedup
BASTION
2.376
3.753
5.13
6.507
May 28, 2026
Speedup
Tau (τ)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Speedup
Tau (τ)
BASTION
Model=Qwen3-4B, Temper...
2026.05
7.68
8.74
BASTION
Model=Qwen3-4B, Temper...
2026.05
7.22
8.81
BASTION
Model=Qwen3-8B, Temper...
2026.05
7.04
8.62
BASTION
Model=Qwen3-8B, Temper...
2026.05
6.66
8.57
DFlash
Model=Qwen3-4B, Temper...
2026.05
5.4
6.12
DFlash
Model=Qwen3-8B, Temper...
2026.05
5.27
5.98
DFlash
Model=Qwen3-4B, Temper...
2026.05
4.99
5.63
DFlash
Model=Qwen3-8B, Temper...
2026.05
4.6
5.26
EAGLE-3
Model=Qwen3-4B, Temper...
2026.05
2.95
2.47
EAGLE-3
Model=Qwen3-4B, Temper...
2026.05
2.94
2.38
EAGLE-3
Model=Qwen3-8B, Temper...
2026.05
2.82
2.2
EAGLE-3
Model=Qwen3-8B, Temper...
2026.05
2.58
2.21
Feedback
Search any
task
Search any
task
