Share your thoughts, 1 month free Claude Pro on usSee more

Code Generation on Python (held-out eval)

37.7Pass@1

Qwen2.5-32B-Instruct (frozen)

Updated 1mo ago

Evaluation Results

Method	Links
Qwen2.5-32B-Instruct (frozen) 2026.06		37.7
Qwen2.5-7B base 2026.06		25
Qwen2.5-7B + CARE 5 campaigns 2026.06		20
Qwen2.5-7B + naive 5 campaigns 2026.06		12.3