Task Goal Completion on AppWorld Hard 63 tasks (test_normal)
31.7Accuracy
No compression
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.06 | 31.7 | 11.95 | 0 | |
2026.06 | 17.5 | 6.58 | 0 | |
2026.06 | 14.3 | 7.79 | 0 | |
2026.06 | 4.8 | 5.68 | 7.37 |
No compression
| Method | Links | |||
|---|---|---|---|---|
2026.06 | 31.7 | 11.95 | 0 | |
2026.06 | 17.5 | 6.58 | 0 | |
2026.06 | 14.3 | 7.79 | 0 | |
2026.06 | 4.8 | 5.68 | 7.37 |