Share your thoughts, 1 month free Claude Pro on usSee more

Software Engineering Task Resolution on SWE-Gym (Holdout)

19Task Resolution Rate

DAgger-style

Updated 2mo ago

Evaluation Results

Method	Links
DAgger-style 2026.05		19
DAgger-style 2026.05		17
AggreVaTe-style 2026.05		17
Qwen3-4B + OPD 2026.05		16
AggreVaTe-style 2026.05		16
Qwen3-8B + OPD 2026.05		16
Qwen3-4B + SFT 2026.05		15
Qwen3-8B + SFT 2026.05		12
Qwen3-4B + GRPO 2026.05		8
Qwen3-4B 2026.05		5
Qwen3-8B + GRPO 2026.05		4
Qwen3-8B 2026.05		2