Role Consistency on SWE easy subset dev (test)
10Overstepping Rate (<INFO>)
ChatDev (Joint FT)
Updated 13d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.04 | 10 | 10.4 | -33 | -55.4 | |
2026.04 | 19.2 | 34.4 | -23.8 | -31.4 | |
2026.04 | 37.2 | 37.6 | -5.8 | -28.2 | |
2026.04 | 43 | 65.8 | - | - |
ChatDev (Joint FT)
| Method | Links | ||||
|---|---|---|---|---|---|
2026.04 | 10 | 10.4 | -33 | -55.4 | |
2026.04 | 19.2 | 34.4 | -23.8 | -31.4 | |
2026.04 | 37.2 | 37.6 | -5.8 | -28.2 | |
2026.04 | 43 | 65.8 | - | - |