Software Engineering Problem Solving on SWE-Bench Verified
25.8Rounds Taken
Mini SWE Agent + LaMR
Updated 2mo ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2026.05 | 25.8 | 380 | 76 | 0.4 | 0.453 | 3 | |
2026.05 | 26.8 | 383 | 76.6 | 1 | 0.498 | 6.6 | |
2026.05 | 30.9 | 378 | 75.6 | - | 0.467 | - | |
2026.05 | 39.6 | 359 | 71.8 | 1.2 | 0.633 | 30.5 | |
2026.05 | 41.7 | 360 | 72 | 1.4 | 0.701 | 23.1 | |
2026.05 | 51 | 353 | 70.6 | - | 0.911 | - |