Share your thoughts, 1 month free Claude Pro on usSee more

Software Engineering Issue Resolution on SWE-bench Verified

67.5Resolution Rate

Orchard-SWE (SFT+RL)

Updated 19d ago

Evaluation Results

Method	Links
Orchard-SWE (SFT+RL) 2026.05		67.5
OpenSWE-72B 2026.05		66
OpenSWE-72B 2026.05		65
Orchard-SWE (SFT) 2026.05		64.3
Scale-SWE-Agent 2026.05		64
OpenSWE-32B 2026.05		62.4
Orchard-SWE (SFT) 2026.05		62.1
SWE-Master-32B-RL 2026.05		61.4
Kimi-Dev 2026.05		60.6
OpenSWE-32B 2026.05		59.8
CoderForge-32B 2026.05		59.4
GLM-4.7-Flash-30A3B 2026.05		59.2
daVinci-Dev-72B 2026.05		58.5
SWE-Master-32B 2026.05		57.8
SWE-Compressor 2026.05		57.6
daVinci-Dev-32B 2026.05		56.1
FrogBoss 2026.05		54.6
SWE-Lego-Qwen3-32B 2026.05		52.6
SWE-Mirror-LM 2026.05		52.2
Qwen3-Coder-30B-A3B-Instruct 2026.05		51.6
SWE-Agent-LM 2026.05		40.2
Skywork-SWE 2026.05		38
Openhands-LM 2026.05		37.2
R2EGym-Agent 2026.05		34.4
SWE-Fixer-72B 2026.05		32.8
Qwen3-30B-A3B-Instruct 2026.05		22