Software Engineering on SWE-bench Verified (Success Rate (%))

80.9Success Rate

Claude-Opus-4.5

Updated 1mo ago

Evaluation Results

Method	Links
Claude-Opus-4.5 2026.06		80.9
GPT-5.1 2026.06		76.3
Gemini-3-Pro 2026.06		76.2
GLM-4.7 2026.06		73.8
DeepSeek-V3.2 2026.06		73.1
OpenHands 2026.04		71.8
OpenHands 2026.04		70.4
Qwen3-Coder 2026.04		69.6
Kimi-K2-Instruct-0905 2026.06		69.2
Qwen3-Coder-480B-A35B-Instruct 2026.06		67
SWE-agent 2026.04		66.6
Kimi-K2 2026.04		65.4
LoopCoder-v2 2026.06		64.4
GLM-4.5 2026.04		64.2
Kimi-Dev-72B 2026.06		60.4
CodeFuse-CGM 2026.04		50.4
Best DGM agent 2026.06		50
ENTROPO-KTO 2026.04		49.3
Kimi-Dev 2026.04		48.6
Qwen3-235B-A22B-Instruct-2507 2026.06		45.2
DeepSWE+AEM 2026.05		43.7
LoopCoder-v2 2026.06		43
DeepSWE 2026.05		42.3
DeepSWE 2026.04		42.2
SWE-RL 2026.04		41
SWE-smith 2026.04		40.2
Agentless-1.5 2026.04		38.8
Skywork-SWE 2026.04		38
SWE-Dev 2026.04		36.6
R2EGym 2026.04		34.4
SWE-fixer 2026.04		32.8
SWE-AGILE (SFT) 2026.04		30.06
LoopCoder-v2 2026.06		27.6
R2EGym 2026.04		26.8
Best DGM agent 2026.06		24.5
SWE-AGILE (SFT+RL) 2026.04		24.1
SWE-Dev 2026.04		23.4
LoopCoder-v2 2026.06		22.4
SkyRL-Agent-v0 2026.04		21.6
SWE-AGILE (SFT) 2026.04		21.45
SWE-Gym 2026.04		20.6
Initial agent 2026.06		20
Initial agent 2026.06		20
R2EGym 2026.04		19
SWE-Gym 2026.04		16.4
Qwen3 2026.04		15.83
SWE-smith 2026.04		15.2
SWE-Gym 2026.04		10.6
DeepSeek-Coder-V2-Lite-Instruct 2026.06		0
Qwen2.5-Coder-7B-Instruct 2026.06		0
Seed-Coder-8B-Instruct 2026.06		0
Qwen2.5-Coder-14B-Instruct 2026.06		0
Qwen2.5-Coder-32B-Instruct 2026.06		0