Share your thoughts, 1 month free Claude Pro on usSee more

Code generation on MBPP (Acceptance length (τ))

2.032Acceptance Length (τ)

Qwen3-8B

Updated 1mo ago

Evaluation Results

Method	Links
Qwen3-8B 2026.06		2.032
Qwen3-8B 2026.06		2.241
Llama-3-8B 2026.06		2.298
Qwen3-8B 2026.06		2.306
Qwen3-4B 2026.06		2.396
Llama-3-8B 2026.06		2.412
Qwen3-8B 2026.06		2.466
Qwen3-4B 2026.06		2.596
Qwen3-4B 2026.06		2.618
Llama-3-8B 2026.06		2.72
Qwen3-4B 2026.06		2.958
Llama-3-8B 2026.06		3.088
Llama 3.2-3B 2026.06		3.11
Llama 3.2-3B 2026.06		3.3
Llama 3.2-3B 2026.06		3.382
Llama 3.2-3B 2026.06		3.933