ScreenSpot
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| GUI Grounding | ScreenSpot Pro | Average Score7,350 | 482 | |
| GUI Grounding | ScreenSpot v2 | Avg Accuracy96.5 | 447 | |
| GUI Grounding | ScreenSpot Pro | Accuracy72.7 | 221 | |
| GUI Grounding | ScreenSpot | Avg Acc92 | 169 | |
| Grounding | ScreenSpot Pro | Average Grounding Accuracy51.8 | 82 | |
| GUI Grounding | ScreenSpot Web V2 | Text Accuracy98.3 | 78 | |
| GUI Grounding | ScreenSpot Desktop V2 | Text Accuracy100 | 78 | |
| GUI Grounding | ScreenSpot Mobile V2 | Text Accuracy100 | 78 | |
| GUI Grounding | ScreenSpot-Pro (test) | Element Accuracy74.1 | 67 | |
| Grounding | ScreenSpot V2 | Grounding Accuracy94.73 | 50 | |
| GUI Grounding | ScreenSpot (test) | Element Accuracy90.6 | 42 | |
| GUI Grounding | Screenspot v1 | Average Accuracy91.67 | 39 | |
| GUI Grounding | ScreenSpot v2 (test) | Element Accuracy95.6 | 33 | |
| Grounding | ScreenSpot v2 (test) | Overall Accuracy95.3 | 29 | |
| Visual Grounding | ScreenSpot-Pro 1.0 (test) | Development Score71.6 | 27 | |
| UI Element Grounding | ScreenSpot Overall v2 | Overall Accuracy (Avg)95.2 | 26 | |
| GUI grounding | ScreenSpot Pro | Click Accuracy61.9 | 25 | |
| GUI Grounding | ScreenSpot v1 (test) | Mobile Text Acc98.6 | 25 | |
| GUI Element Injection Attack Success | ScreenSpot Pro (885-sample split) | Attack Success Rate (ASR)100 | 24 | |
| GUI Interaction | ScreenSpot V1 | Avg Acc92 | 23 | |
| GUI Grounding | ScreenSpot V1 (Overall) | Average Accuracy89.9 | 22 | |
| GUI Element Localization | ScreenSpot Pro | Accuracy34.5 | 20 | |
| Visual Grounding | ScreenSpot | Accuracy88.7 | 20 | |
| GUI Grounding | Screenspot Web | Text Accuracy91 | 18 | |
| GUI Grounding | Screenspot Desktop | Text Acc95.9 | 18 |
Showing 25 of 66 rows