GUI-Odyssey
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mobile GUI Automation | GUI-Odyssey | Success Rate (SR)87 | 62 | |
| GUI Interaction Control | GUI-Odyssey | SR87 | 31 | |
| GUI Automation | GUI Odyssey | Task Metric (TM)94.6 | 15 | |
| Mobile Agent Navigation | GUI Odyssey 1.0 (test) | Step Success Rate (SR)81.7 | 15 | |
| Step Execution | GUI-Odyssey | Step Success Rate89.1 | 14 | |
| GUI Generation | GUI Odyssey OOD | Sad93.45 | 14 | |
| Long-term Planning | GUI-Odyssey | Type Success Rate66.26 | 14 | |
| Mobile Use Navigation | GUI Odyssey static offline benchmark | Success Rate83.4 | 9 | |
| GUI Action Grounding | GUI-Odyssey (test) | Type Accuracy84.47 | 8 | |
| Mobile Agent Evaluation | GUI-Odyssey (test) | Grounding87.02 | 8 | |
| GUI Navigation | GUI Odyssey 15 (Overall) | Success Rate73.97 | 7 | |
| GUI Agent Navigation and Action | GUI-Odyssey | Type Accuracy88.54 | 7 | |
| GUI Agent | GUI-Odyssey | Type Accuracy90.74 | 7 | |
| Android GUI Navigation | GUI Odyssey | Success Rate73.97 | 5 | |
| GUI Agent Navigation | GUI-Odyssey (test) | Type Accuracy66 | 4 | |
| GUI Navigation | GUI-Odyssey High | Action Matching Score (AMS)75.8 | 4 |
Showing 16 of 16 rows