Share your thoughts, 1 month free Claude Pro on usSee more

Software Engineering Issue Resolution on SWE-bench Verified

89.2Resolution Rate

MiniMax-M2.5

Updated 1mo ago

Evaluation Results

Method
MiniMax-M2.5 2026.06	89.2	-	-
MiniMax-M2.5 2026.06	87.8	-	-
Qwen3-Coder-480B-A35B 2026.06	86.2	-	-
Qwen3-Coder-480B-A35B 2026.06	82.6	-	-
Simple Strands Agent 2026.06	80.8	82.54	80.8
Simple Strands Agent 2026.06	80.8	84.14	80.6
Simple Strands Agent 2026.06	80.48	83.3	80.9
Simple Strands Agent 2026.06	80.16	83.4	-
Simple Strands Agent 2026.06	79.52	82.2	-
Simple Strands Agent 2026.06	79.28	81.72	80
Simple Strands Agent 2026.06	79	82.06	79.6
Simple Strands Agent 2026.06	78.32	81.76	78
Simple Strands Agent 2026.06	77.56	80.76	-
Simple Strands Agent 2026.06	76.8	79.98	-
MiniMax-M2.5 2026.06	76.6	-	-
Simple Strands Agent 2026.06	76.4	79.94	77.2
Simple Strands Agent 2026.06	76.24	80.52	77.2
Qwen3-Coder-30B-A3B 2026.06	76	-	-
MiniMax-M2.5 2026.06	74.5	-	-
MiniMax-M2.5 2026.06	74.4	-	-
Simple Strands Agent 2026.06	74.36	79.5	72.4
Qwen3-Coder-30B-A3B 2026.06	73.4	-	-
Simple Strands Agent 2026.06	72.92	77.76	73.4
MiniMax-M2.5 2026.06	72.8	-	-
Simple Strands Agent 2026.06	72.6	77.3	73.3
Simple Strands Agent 2026.06	72.44	78.2	71.3
MiniMax-M2.5 2026.06	72.2	-	-
Simple Strands Agent 2026.06	72	76.82	72.7
MiniMax-M2.5 2026.06	71.8	-	-
Qwen3-Next-80B-A3B-Instruct 2026.06	71	-	-
MiniMax-M2.5 2026.06	70.4	-	-
Qwen3-Coder-Next 2026.06	68.4	-	-
Qwen3-Next-80B-A3B-Instruct 2026.06	68.4	-	-
Simple Strands Agent 2026.06	67.56	73.66	69.6
Orchard-SWE (SFT+RL) 2026.05	67.5	-	-
MiniMax-M2.5 2026.06	67.2	-	-
OpenSWE-72B 2026.05	66	-	-
OpenSWE-72B 2026.05	65	-	-
Simple Strands Agent 2026.06	64.64	71.9	62
Qwen3-Coder-Next 2026.06	64.6	-	-
Orchard-SWE (SFT) 2026.05	64.3	-	-
Scale-SWE-Agent 2026.05	64	-	-
MiniMax-M2.5 2026.06	64	-	-
Qwen3-Coder-480B-A35B 2026.06	64	-	-
Qwen3.5 2026.06	63.5	-	-
Qwen3-Coder-480B-A35B 2026.06	63	-	-
Qwen3-Coder-480B-A35B 2026.06	63	-	-
Qwen3-Coder-480B-A35B 2026.06	62.8	-	-
Qwen3-Coder-480B-A35B 2026.06	62.8	-	-
Qwen3-Coder-480B-A35B 2026.06	62.6	-	-
OpenSWE-32B 2026.05	62.4	-	-
Orchard-SWE (SFT) 2026.05	62.1	-	-
Keye-VL-2.0-30B-A3B 2026.06	62	-	-
Qwen3-Coder-480B-A35B 2026.06	61.8	-	-
Qwen3-Coder-480B-A35B 2026.06	61.6	-	-
SWE-Master-32B-RL 2026.05	61.4	-	-
MiniMax-M2.5 2026.06	61	-	-
Kimi-Dev 2026.05	60.6	-	-
Simple Strands Agent 2026.06	59.84	68.54	60
OpenSWE-32B 2026.05	59.8	-	-
CoderForge-32B 2026.05	59.4	-	-
GLM-4.7-Flash-30A3B 2026.05	59.2	-	-
Qwen3-Coder-480B-A35B 2026.06	58.6	-	-
daVinci-Dev-72B 2026.05	58.5	-	-
SWE-Master-32B 2026.05	57.8	-	-
Qwen3-Coder-480B-A35B 2026.06	57.8	-	-
SWE-Compressor 2026.05	57.6	-	-
daVinci-Dev-32B 2026.05	56.1	-	-
GPT-5-mini 2026.06	55.5	-	-
FrogBoss 2026.05	54.6	-	-
Qwen3-Coder-Next 2026.06	54.6	-	-
Qwen3-Coder-30B-A3B 2026.06	54	-	-
Qwen3-Coder-Next 2026.06	53.2	-	-
Qwen3-Coder-Next 2026.06	53.2	-	-
Qwen3-Coder-30B-A3B 2026.06	53	-	-
SWE-Lego-Qwen3-32B 2026.05	52.6	-	-
Qwen3-Coder-30B-A3B 2026.06	52.4	-	-
SWE-Mirror-LM 2026.05	52.2	-	-
Qwen3-Coder-30B-A3B 2026.06	52.2	-	-
Qwen3-Coder-Next 2026.06	52	-	-
Qwen3-Coder-30B-A3B-Instruct 2026.05	51.6	-	-
Simple Strands Agent 2026.06	51.36	59.46	51.6
Qwen3-Next-80B-A3B-Instruct 2026.06	50.6	-	-
Qwen3-Next-80B-A3B-Instruct 2026.06	50.4	-	-
Qwen3-Coder-30B-A3B 2026.06	49.4	-	-
Qwen3-Next-80B-A3B-Instruct 2026.06	49.4	-	-
Qwen3-Next-80B-A3B-Instruct 2026.06	47.8	-	-
Qwen3-Coder-30B-A3B 2026.06	46	-	-
Qwen3-Coder-30B-A3B 2026.06	45.4	-	-
Qwen3-Coder-Next 2026.06	45.2	-	-
Qwen3-Coder-30B-A3B 2026.06	44.7	-	-
Qwen3-Coder-Next 2026.06	44.6	-	-
Qwen3-Coder-Next 2026.06	44.6	-	-
Qwen3-Coder-Next 2026.06	43.2	-	-
Qwen3-Next-80B-A3B-Instruct 2026.06	41.6	-	-
Qwen3-Coder-Next 2026.06	41.2	-	-
SWE-Agent-LM 2026.05	40.2	-	-
Qwen3-Coder-30B-A3B 2026.06	40.2	-	-
Qwen3-Coder-30B-A3B 2026.06	40.2	-	-
Qwen3-Coder-Next 2026.06	39.2	-	-

Showing 100 of 110 rows