Software Engineering on SWE-Bench Verified (Pass %, Out tok, Energy)
72Pass Rate
HyperAgent + Librarian
Updated 6d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.05 | 72 | 26.3 | 91.45 | |
2026.05 | 71.8 | 24.3 | 88.96 | |
2026.05 | 71.8 | 19.7 | 71.76 | |
2026.05 | 71.6 | 24.6 | 14.66 | |
2026.05 | 71.4 | 13.5 | 51.21 | |
2026.05 | 70.4 | 20.6 | 12.37 | |
2026.05 | 70.2 | 26.2 | 122.91 | |
2026.05 | 70.2 | 17.5 | 66.2 | |
2026.05 | 69.8 | 28.5 | 17.45 | |
2026.05 | 69.8 | 35.4 | 121.84 | |
2026.05 | 68.4 | 24.7 | 14.79 | |
2026.05 | 68 | 21.9 | 79.4 | |
| 67.6 | 18 | 66.05 | ||
2026.05 | 67.2 | 42.2 | 22.73 | |
2026.05 | 66.2 | 37.7 | 19.99 | |
| 66.2 | 34.7 | 18.63 | ||
2026.05 | 66 | 48.5 | 25.64 | |
| 64.8 | 34 | 135.84 | ||
2026.05 | 63.2 | 33.5 | 26.87 | |
| 56.8 | 53.3 | 34.79 |