Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WebArena

Benchmarks

Task NameDataset NameSOTA ResultTrend
Web navigationWebArena
Overall Success Rate61.7
138
Web navigation and task completionWebArena (test)
Average Task Completion15.45
137
Web AgentWebArena
Success Rate35.8
56
GUI Agent Planning and ExecutionWebArena
Success Rate (Gitlab)70
32
Web NavigationWebArena Lite
Average Success Rate61.8
31
Web AutomationWebArena
Success Rate53.7
19
Web NavigationWebArena Lite v2
Average Success Rate28.6
19
Web Agent NavigationWebArena
Success Rate45.9
19
Web AgentWebArena Lite
SR21.2
18
Web agent task completionWebArena (test)
Shopping Success Rate42.9
18
Web Agent Task SuccessWebArena Overall 684 tasks
Task Success Rate (SR)56.3
15
Web Agent Task SuccessWebArena Multi 29 tasks
Task Success Rate (SR)20.7
15
Web Agent Task SuccessWebArena Reddit 106 tasks
Success Rate (SR)83
15
Web Agent Task SuccessWebArena Gitlab 180 tasks
Task Success Rate (SR)46.7
15
Web Agent Task SuccessWebArena 182 tasks (Admin)
Success Rate (SR)58.2
15
Web Agent Task SuccessWebArena Shopping 187 tasks
Task Success Rate54
15
GUI Task AutomationWebArena Lite v2
Success Rate45.5
14
Reward ModelingWebArena
Pairwise Accuracy88.43
13
Web NavigationWebArena Average
Success Rate50.74
12
Web Agent Task SuccessWebArena
Task Success Rate (TSR)27.8
12
Prefix-risk rankingWebArena (held-out)
AUPRC90
11
Web Agent NavigationWebArena (test)
Success Rate53.8
10
Composing auto-generated skillsWebArena
Skill Step Percentage57.6
9
Continual-memory deploymentWebArena
Macro-Averaged Success Rate52.3
9
Web Navigation and Task AutomationWebArena Continual-memory deployment
Success Rate (SR)52.3
9
Showing 25 of 65 rows