AITW
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| GUI navigation | AITW (test) | Install Success Rate78.86 | 27 | |
| GUI Navigation | AITW | Overall Success Rate67.3 | 19 | |
| GUI Automation | AITW Gen | PG19.5 | 12 | |
| Mobile Device Control | AitW WebShopping | SR68.3 | 6 | |
| Mobile Device Control | AitW General | Success Rate86.5 | 6 | |
| Mobile Agent Action Execution | AITW SeeClick | Action Match Score (AMS)62.14 | 5 | |
| UI Task Completion | AITW | Overall Task Time7.7 | 5 | |
| Mobile GUI action matching | AITW instruction-wise (test) | Overall Error7.7 | 5 | |
| GUI agent task planning | AITW | General Step Accuracy36.34 | 4 | |
| GUI Agent Navigation | AITW (First 128 task samples) | General Success Rate73.2 | 2 | |
| GUI Agent Navigation | AITW First 96 task samples | General Success0.7225 | 2 |
Showing 11 of 11 rows