Robosuite
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Robot Manipulation | Robosuite Can | Total Steps10.1 | 17 | |
| Robot Manipulation | Robosuite Lift | Total Steps4.4 | 17 | |
| Robot Manipulation | Robosuite Square | Total Steps15.5 | 16 | |
| Stack | Robosuite 1.4 (test) | IQM73 | 12 | |
| Lift | Robosuite 1.4 (test) | IQM233.9 | 12 | |
| NutAssemblySquare | Robosuite 1.4 (test) | IQM108.6 | 12 | |
| Door | Robosuite 1.4 (test) | IQM291 | 12 | |
| Wipe | Robosuite 1.4 (test) | IQM74.1 | 12 | |
| Mug Cleanup | Robosuite Unseen views | Success Rate0.2785 | 9 | |
| Mug Cleanup | Robosuite Seen views | Success Rate56.75 | 9 | |
| Coffee | Robosuite Unseen views | Success Rate12.65 | 9 | |
| Coffee | Robosuite Seen views | Success Rate63 | 9 | |
| Stack Three | Robosuite Unseen views | Success Rate53.65 | 9 | |
| Stack Three | Robosuite Seen views | Success Rate69 | 9 | |
| Square | Robosuite Unseen views | Success Rate19.8 | 9 | |
| Square | Robosuite Seen views | Success Rate69 | 9 | |
| Lift | Robosuite Unseen views | Success Rate94.7 | 9 | |
| Lift | Robosuite Seen views | Success Rate99.5 | 9 | |
| State Probing | RoboSuite Stacking | R2 Score0.78 | 8 | |
| Value Estimation | Suboptimal-RoboSuite Value-Bench | Hesitation RMSE0.04 | 7 | |
| Pick-and-Place | RoboSuite online finetuning | Mean Success Rate73.7 | 7 | |
| Door Opening | RoboSuite online finetuning | Mean Success Rate65.2 | 7 | |
| Nut Assembly | RoboSuite online finetuning | Mean Success Rate55.6 | 7 | |
| Block Stacking | RoboSuite online finetuning | Mean Success Rate79.8 | 7 | |
| Continuous Control | Robosuite Table Wiping | Final Reward76.6 | 7 |
Showing 25 of 66 rows