Share your thoughts, 1 month free Claude Pro on usSee more

Agentic Software Engineering on SWE-bench Multilingual (SWE-M)

50Success Rate

Claude-Opus-4.5

Updated 1mo ago

Evaluation Results

Method	Links
Claude-Opus-4.5 2026.06		50
Gemini-3-Pro 2026.06		42.7
DeepSeek-V3.2 2026.06		37.4
Kimi-K2-Instruct-0905 2026.06		33.5
Qwen3-Coder-480B-A35B-Instruct 2026.06		32.7
LoopCoder-v2 2026.06		31
LoopCoder-v2 2026.06		14
LoopCoder-v2 2026.06		11
LoopCoder-v2 2026.06		9.3
DeepSeek-Coder-V2-Lite-Instruct 2026.06		0
Qwen2.5-Coder-7B-Instruct 2026.06		0
Seed-Coder-8B-Instruct 2026.06		0
Qwen2.5-Coder-14B-Instruct 2026.06		0
Qwen2.5-Coder-32B-Instruct 2026.06		0