| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| SWE-bench Verified single-run, single-patch evaluation protocol (test) | Qwen3-Coder | Resolution Rate51.6 | 11 | 15d ago | |
| Aggregated (RebenchT, CodeCI, Bird) | TDScaling | Overall Average Score34.99 | 5 | 3mo ago | |
| Bird | TDScaling | Pass@143.83 | 5 | 3mo ago | |
| CodeCI | TDScaling | Avg@239.43 | 5 | 3mo ago | |
| RebenchT | TDScaling | OH-p@133.13 | 5 | 3mo ago |
