| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| AppWorld (test challenge) | Goal Completion Score32 | 16 | 2mo ago | ||
| AppWorld | HINT-SD-Multi | Average Completion Score @418.46 | 7 | 15d ago | |
| AppWorld Challenge Qwen-2.5-32B (test) | ADAPO | Average Task Completion Score51 | 4 | 2mo ago | |
| AppWorld Normal Qwen-2.5-32B (test) | LOOP | Average Task Completion Score75 | 4 | 2mo ago |