Webshop
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| E-commerce Navigation and Search | WebShop semantic shift Hidden drift | Score100 | 63 | |
| Web Navigation and Shopping | Webshop | Success Rate82.8 | 33 | |
| Interactive Decision Making | WebShop (test) | Score93.1 | 28 | |
| Interactive web-based shopping tasks | WebShop | Score92.2 | 28 | |
| Web Navigation | WebShop Source | Success Rate100 | 27 | |
| Web-based Agent Interaction | WebShop (test) | Success Rate73 | 25 | |
| Web Task | WebShop | Average Reward69.2 | 24 | |
| Online Shopping | Webshop | LLM Score0.63 | 22 | |
| World Modeling | Webshop (test) | Search100 | 20 | |
| Web Navigation | WebShop Drift II | Success Rate95 | 18 | |
| Web Navigation | WebShop Drift I | Success Rate95 | 18 | |
| Online Shopping | WebShop Source | Score100 | 18 | |
| Web Navigation | WebShop Drift II - Semantic Shift | Success Rate95 | 18 | |
| Web Navigation | WebShop Drift I - Semantic Shift | Success Rate95 | 18 | |
| E-commerce Navigation and Search | WebShop semantic shift Source | Score1 | 18 | |
| Agent Task | WebShop | Success Rate43.2 | 17 | |
| Agent Behavior Adaptation | WebShop (WS) (test) | Loop Ratio36.7 | 17 | |
| Next-state prediction | WebShop (WS) | EM Accuracy79.05 | 16 | |
| Web Navigation | WebShop unseen (test) | Score87.2 | 14 | |
| Task success | WebShop | Real Success Score61 | 14 | |
| Web Navigation | WebShop Implicit Hidden Drift | Success Rate (Source)100 | 14 | |
| Web Navigation | WebShop Explicit Structural Drift II | Success Rate (Source)95 | 14 | |
| Web navigation | WebShop | Average Score71.3 | 13 | |
| Web Navigation | WebShop (test) | Score0.8935 | 12 | |
| Sequential Decision Making | WebShop | Score0.88 | 11 |
Showing 25 of 45 rows