ScreenSpot
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| GUI Grounding | ScreenSpot Pro | Average Score7,350 | 458 | |
| GUI Grounding | ScreenSpot v2 | Avg Accuracy96.5 | 371 | |
| GUI Grounding | ScreenSpot Pro | Accuracy72.7 | 195 | |
| GUI Grounding | ScreenSpot | Avg Acc92 | 160 | |
| Grounding | ScreenSpot Pro | Average Grounding Accuracy51.8 | 82 | |
| GUI Grounding | ScreenSpot Web V2 | Text Accuracy97.9 | 60 | |
| GUI Grounding | ScreenSpot Desktop V2 | Text Accuracy100 | 60 | |
| GUI Grounding | ScreenSpot Mobile V2 | Text Accuracy100 | 60 | |
| Grounding | ScreenSpot V2 | Grounding Accuracy94.73 | 47 | |
| GUI Grounding | ScreenSpot-Pro (test) | Element Accuracy58.66 | 43 | |
| GUI Grounding | ScreenSpot (test) | Element Accuracy90.6 | 42 | |
| GUI Grounding | Screenspot v1 | Average Accuracy91.67 | 39 | |
| Grounding | ScreenSpot v2 (test) | Overall Accuracy95.3 | 29 | |
| Visual Grounding | ScreenSpot-Pro 1.0 (test) | Development Score71.6 | 27 | |
| UI Element Grounding | ScreenSpot Overall v2 | Overall Accuracy (Avg)95.2 | 26 | |
| GUI Grounding | ScreenSpot v1 (test) | Mobile Text Acc98.6 | 25 | |
| GUI Element Injection Attack Success | ScreenSpot Pro (885-sample split) | Attack Success Rate (ASR)100 | 24 | |
| GUI Interaction | ScreenSpot V1 | Avg Acc92 | 23 | |
| GUI Grounding | ScreenSpot V1 (Overall) | Average Accuracy89.9 | 22 | |
| GUI Element Localization | ScreenSpot Pro | Accuracy34.5 | 20 | |
| Visual Grounding | ScreenSpot | Accuracy88.7 | 20 | |
| GUI Grounding | Screenspot Web | Text Accuracy91 | 18 | |
| GUI Grounding | Screenspot Desktop | Text Acc95.9 | 18 | |
| GUI Grounding | Screenspot Mobile | Text Accuracy96.3 | 18 | |
| GUI Visual Grounding | ScreenSpot Standard Setting 1.0 | Accuracy (Mobile, Text)94.1 | 15 |
Showing 25 of 65 rows