Agentic Task Completion on AppWorld normal Hard (test)
39.7Accuracy
No compression
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.10 | 39.7 | 11.95 | 9.11 | |
2025.10 | 31.8 | 9.14 | 7.5 | |
2025.10 | 30.2 | 7.44 | 6.55 | |
2025.10 | 28.6 | 7.65 | 6.37 | |
2025.10 | 27 | 7.79 | 6.07 | |
2025.10 | 27 | 9.07 | 7.73 | |
2025.10 | 23.8 | 7.31 | 7.48 | |
2025.10 | 15.9 | 7.14 | 7.8 | |
2025.10 | 15.9 | 8.09 | 8.59 | |
2025.10 | 14.3 | 10.29 | 9.92 | |
2025.10 | 7.9 | 9.02 | 8.33 |