Long-Horizon Evaluation with Simulator Feedback on 10 manifest-defined shared-core domains (de novo)
29Success Rate (1-turn)
Sonnet 4.5
Updated 1mo ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2026.03 | 29 | 66.5 | 69.5 | 37.5 | 3 | |
2026.03 | 25.6 | 62.5 | 67 | 36.9 | 4.5 | |
2026.03 | 24 | 57.3 | 60.5 | 33.4 | 3.2 | |
2026.03 | 23.8 | 65.5 | 76 | 41.7 | 10.5 | |
2026.03 | 22.9 | 66.5 | 71.5 | 43.6 | 5 | |
2026.03 | 19.5 | 43.2 | 60.5 | 23.7 | 17.3 | |
2026.03 | 12.8 | 53 | 55 | 40.2 | 2 |