| SWE-bench Verified (test) | | Pass Rate77.2 | | 36 | 4d ago |
| SWE-Bench Sphinx Verified (test) | GLM-4.5-Air | Accuracy43.51 | | 3 | 4d ago |
| SWE-Bench Sympy Verified (test) | SERA-32B-Sympy | Accuracy51.11 | | 3 | 4d ago |
| SWE-Bench Django Verified (test) | SERA-32B-Django | Accuracy52.23 | | 3 | 4d ago |
| httpx GitHub Issues OSS repo (10 randomly selected) | AIR | Issues Resolved (%)900 | | 3 | 4d ago |
| urllib3 GitHub Issues (10 randomly selected issues) | AIR | Issue Resolution Rate900 | | 3 | 4d ago |
| tinydb GitHub Issues OSS repo (10 randomly selected) | Claude 4 Sonnet | Issues Resolved6 | | 3 | 4d ago |
| python-qrcode GitHub Issues OSS GitHub repo (10 randomly selected issues) | AIR | Issues Resolved8 | | 3 | 4d ago |
| Pillow GitHub Issues OSS repo (10 randomly selected) | AIR | Issues Resolved4 | | 3 | 4d ago |
| poetry GitHub Issues OSS repo (10 randomly selected) | AIR | Issues Resolved4 | | 3 | 4d ago |
| requests GitHub Issues OSS GitHub repo (10 randomly selected issues) | AIR | Resolved Issues8 | | 3 | 4d ago |
| fashtext GitHub Issues OSS repo (10 randomly selected) | AIR | Issues Resolved8 | | 3 | 4d ago |
| arrow-py OSS GitHub repo (10 randomly selected issues) | AIR | Issues Resolved6 | | 3 | 4d ago |
| jsonpickle GitHub Issues OSS repo (10 randomly selected) | AIR | Issues Resolved9 | | 3 | 4d ago |
