AndroidWorld
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| GUI Agent Task | AndroidWorld | Success Rate80 | 104 | |
| Mobile Task Automation | AndroidWorld (test) | Average Success Rate1 | 75 | |
| GUI Agent | AndroidWorld | Accuracy62 | 70 | |
| GUI navigation | AndroidWorld latest (test) | Success Rate76.7 | 35 | |
| End-to-end GUI Navigation | AndroidWorld | Success Rate77.6 | 21 | |
| Mobile GUI Agents | AndroidWorld 138 tasks (test) | Success Rate71.1 | 18 | |
| Reward Modeling | AndroidWorld | Precision92.5 | 14 | |
| End-to-End Environment Interaction | AndroidWorld (test) | Pass@180.2 | 14 | |
| Mobile GUI Agent Decision Making | AndroidWorld | Success Rate59.5 | 5 | |
| Mobile operating system task execution | AndroidWorld (AW) | AUV43.2 | 4 | |
| Evaluator Accuracy | AndroidWorld | Overall Acc87.9 | 3 |
Showing 11 of 11 rows