| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| SWE-bench Verified | Orchard-SWE (SFT+RL) | Resolution Rate67.5 | 26 | 19d ago | |
| SWE-Bench Lite | AIR | Resolution Rate73.5 | 16 | 3mo ago | |
| SWE-Bench Lite | Context Weaver | Pass@153.7 | 10 | 1mo ago | |
| SWE-Bench Multilingual | Nemotron 3 Super | Resolve Rate45.78 | 6 | 1mo ago | |
| SWE-Bench Verified 100-instance | ContextWeaver | Pass@168 | 5 | 19d ago | |
| Terminal Bench | Hybrid | Resolve Rate32.5 | 4 | 3mo ago | |
| Multi-SWE-Bench Mini | Hybrid | Resolution Rate20 | 4 | 3mo ago | |
| SWE-Bench Live Lite | Hybrid | Resolve Rate0.224 | 4 | 3mo ago | |
| SWE-bench 500 (test) | agyn | Resolution Score72.2 | 4 | 3mo ago |
