Webshop
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Web Navigation and Shopping | Webshop | Score100 | 248 | |
| Online Shopping | Webshop | Score91.5 | 115 | |
| Interactive web-based shopping tasks | WebShop | Success Rate80.5 | 80 | |
| Interactive Decision Making | WebShop | Success Rate84.02 | 77 | |
| Web Shopping Agent | WebShop | Success Rate (SR)82.9 | 72 | |
| E-commerce Navigation and Search | WebShop semantic shift Hidden drift | Score100 | 63 | |
| Online Shopping | WebShop (test) | Score95 | 59 | |
| Agentic reasoning | WebShop | Success Rate74.1 | 59 | |
| Agent Task | WebShop | Success Rate99 | 57 | |
| Web navigation | WebShop | Average Score90.5 | 55 | |
| Agentic web navigation and interaction | WebShop (test) | SR84.38 | 51 | |
| Web-based Agent Interaction | WebShop (test) | Success Rate73 | 42 | |
| Web-based Agent Interaction | WebShop | CoT Match Rate100 | 41 | |
| Interactive Decision Making | WebShop (Seen) | Average Reward62.3 | 40 | |
| Multi-turn agent interaction | WebShop | Success Rate89.06 | 39 | |
| Interactive Decision Making | WebShop (test) | Success Rate97 | 37 | |
| Web Navigation | WebShop (test) | Score91.37 | 36 | |
| E-commerce interaction | WebShop 128 tasks (test) | Score89.4 | 33 | |
| Web-based Agent Interaction | WebShop (val) | Success Rate84.4 | 31 | |
| Mean Reward | WebShop | Mean Reward63.7 | 30 | |
| Online shopping agent navigation | WebShop 128 (val) | Score89.4 | 30 | |
| Web-based Task Automation | WebShop-AC 1.0 (test) | TSR92.6 | 27 | |
| E-commerce product search and purchase | WebShop | Strict Success81.3 | 27 | |
| Web Navigation | WebShop Source | Success Rate100 | 27 | |
| Interactive Decision-making | WebShop | Real39 | 24 |
Showing 25 of 104 rows