Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

OSWorld

Benchmarks

Task NameDataset NameSOTA ResultTrend
GUI GroundingOSWorld-G
Average Score72.7
164
GUI GroundingOSWorld-G (test)
Element Accuracy78.4
52
Computer UseOSWorld
OS Success Rate75
45
OS GUI Agentic Task ExecutionOSWorld 361 tasks (Verified)
OS Success Rate79.17
43
Operating System GUI Agentic ReasoningOSWorld
Success Rate64.29
42
GUI Agent Task CompletionOSWorld 1.0 (test)
Success Rate (OS)91.67
42
GUI AutomationOSWorld Verified (test)
Overall Success Rate61.92
40
GUI GroundingOSWorld G-Refine v1.0 (test)
Overall Success Rate76.1
37
UI Agent EvaluationOSWorld
SR (15 Steps)40.3
34
GUI NavigationOSWorld Verified
OS Success Rate91.7
32
GUI automationOSWorld
Overall Success Rate86.8
28
GUI Agent InteractionOSWorld
Average Accuracy42.5
27
GUI groundingOSWorld-G-Refine
Accuracy76.4
24
Computer task executionOSWorld (verified)
Office Task Score64.8
24
Interactive Desktop Task SuccessOSWorld
Overall Success Rate50.11
23
GUI GroundingOSWorld-G v1.0 (test)
Accuracy67.6
22
GroundingOSWorld
Overall Score64.7
22
GroundingOSworld G-R
Accuracy76.4
22
GroundingOSWorld-G-Refine (test)
Overall Success Rate76.4
17
Agentic PerformanceOSWorld Verified
OS Performance70.8
16
GUI Agent InteractionOSWorld
Success Rate (Max Steps: 15)42.9
16
End-to-End Environment InteractionOSWorld-Verified (test)
Pass@161.4
16
GUI Agent Task SuccessOSWorld
Success Rate24.4
16
Task accuracyOSWorld
Task Accuracy41.49
15
Multimodal Task AccuracyOSWorld
Multimodal Task Accuracy41.49
15
Showing 25 of 68 rows