Task Goal Completion on AppWorld Average 168 tasks (test normal)
44Accuracy
No compression
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.06 | 44 | 19.1 | 92.3 | 0 | |
2026.06 | 41.1 | 21.8 | 69.1 | 0 | |
2026.06 | 34.5 | 30.6 | 56.5 | 0 | |
2026.06 | 26.2 | 33.5 | 51.2 | 5.45 |
No compression
| Method | Links | ||||
|---|---|---|---|---|---|
2026.06 | 44 | 19.1 | 92.3 | 0 | |
2026.06 | 41.1 | 21.8 | 69.1 | 0 | |
2026.06 | 34.5 | 30.6 | 56.5 | 0 | |
2026.06 | 26.2 | 33.5 | 51.2 | 5.45 |