Task Goal Completion on AppWorld Medium 48 tasks (test_normal)
43.8Accuracy
No compression
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.06 | 43.8 | 8.89 | 0 | |
2026.06 | 37.5 | 6.87 | 0 | |
2026.06 | 27.1 | 5.2 | 0 | |
2026.06 | 16.7 | 4.92 | 5.62 |
No compression
| Method | Links | |||
|---|---|---|---|---|
2026.06 | 43.8 | 8.89 | 0 | |
2026.06 | 37.5 | 6.87 | 0 | |
2026.06 | 27.1 | 5.2 | 0 | |
2026.06 | 16.7 | 4.92 | 5.62 |