WebArena
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Web navigation and task completion | WebArena (test) | Average Task Completion15.45 | 137 | |
| Web navigation | WebArena | Overall Success Rate52.6 | 55 | |
| Web Agent | WebArena | Success Rate35.8 | 36 | |
| GUI Agent Planning and Execution | WebArena | Success Rate (Gitlab)70 | 32 | |
| Web Navigation | WebArena Lite | Gitlab SR56.7 | 24 | |
| Web Navigation | WebArena Lite v2 | Average Success Rate28.6 | 19 | |
| Web Agent Navigation | WebArena | Success Rate45.9 | 19 | |
| Web Agent | WebArena Lite | SR21.2 | 18 | |
| Web agent task completion | WebArena (test) | Shopping Success Rate42.9 | 18 | |
| Web Agent Task Success | WebArena Overall 684 tasks | Task Success Rate (SR)56.3 | 15 | |
| Web Agent Task Success | WebArena Multi 29 tasks | Task Success Rate (SR)20.7 | 15 | |
| Web Agent Task Success | WebArena Reddit 106 tasks | Success Rate (SR)83 | 15 | |
| Web Agent Task Success | WebArena Gitlab 180 tasks | Task Success Rate (SR)46.7 | 15 | |
| Web Agent Task Success | WebArena 182 tasks (Admin) | Success Rate (SR)58.2 | 15 | |
| Web Agent Task Success | WebArena Shopping 187 tasks | Task Success Rate54 | 15 | |
| Reward Modeling | WebArena | Pairwise Accuracy88.43 | 13 | |
| Web Agent Task Success | WebArena | Task Success Rate (TSR)27.8 | 12 | |
| Prefix-risk ranking | WebArena (held-out) | AUPRC90 | 11 | |
| Web Agent Navigation | WebArena (test) | Success Rate53.8 | 10 | |
| Continual-memory deployment | WebArena | Macro-Averaged Success Rate52.3 | 9 | |
| Web Navigation and Task Automation | WebArena Continual-memory deployment | Success Rate (SR)52.3 | 9 | |
| Web navigation | WebArena Lite In-distribution | Avg Score (GitLab)60 | 9 | |
| Web Agent | WebArena-Lite OOD | Average Score (Reddit)0.18 | 9 | |
| Web Agent Navigation | WebArena Lite | Success Rate47.9 | 9 | |
| Web Browsing Automation | WebArena (test) | Latency (s)3.9 | 8 |
Showing 25 of 52 rows