Software Engineering Question Answering on SWE-QA Pro
51.4Rubric Judge Accuracy
Predicate-Based Belief State
Updated 23d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.05 | 51.4 | |
2026.05 | 50.9 | |
2026.05 | 48.9 | |
2026.05 | 48.4 | |
2026.05 | 47.7 | |
2026.05 | 43.6 | |
2026.05 | 43 | |
2026.05 | 42.3 | |
2026.05 | 39.8 | |
2026.05 | 37.3 | |
2026.05 | 34.6 | |
2026.05 | 33.7 | |
2026.05 | 33.3 | |
2026.05 | 31.7 | |
2026.05 | 27.3 |