Software Engineering on SWE Lite
10,538Throughput (tok/s)
Draft-OPD
Updated 5d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.05 | 10,538 | 10 | 6.12 | |
2026.05 | 9,604 | - | 5.62 | |
2026.05 | 8,568 | 11 | 6.12 | |
2026.05 | 7,743 | - | 5.62 | |
2026.05 | 6,904 | 13 | 5.27 | |
2026.05 | 6,113 | - | 4.6 | |
2026.05 | 5,611 | 11 | 5.27 | |
2026.05 | 5,544 | 11 | 6.12 | |
2026.05 | 5,051 | - | 4.6 | |
2026.05 | 5,009 | - | 5.62 | |
2026.05 | 3,879 | 15 | 5.27 | |
2026.05 | 3,850 | 11 | 3.81 | |
2026.05 | 3,453 | - | 3.43 | |
2026.05 | 3,347 | - | 4.6 | |
2026.05 | 3,230 | 8 | 6.12 | |
2026.05 | 2,983 | - | 5.62 | |
2026.05 | 2,579 | 10 | 3.81 | |
2026.05 | 2,337 | - | 3.43 | |
2026.05 | 2,263 | 15 | 5.27 | |
2026.05 | 1,962 | - | 4.6 | |
2026.05 | 1,628 | 9 | 3.81 | |
2026.05 | 1,484 | - | 3.43 | |
2026.05 | 976 | 8 | 6.12 | |
2026.05 | 960 | 11 | 3.81 | |
2026.05 | 901 | - | 5.62 | |
2026.05 | 855 | - | 3.43 | |
2026.05 | 644 | 9 | 5.27 | |
2026.05 | 592 | - | 4.6 | |
2026.05 | 352 | 10 | 3.81 | |
2026.05 | 319 | - | 3.43 |