Robosuite
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Stack | Robosuite 1.4 (test) | IQM73 | 12 | |
| Lift | Robosuite 1.4 (test) | IQM233.9 | 12 | |
| NutAssemblySquare | Robosuite 1.4 (test) | IQM108.6 | 12 | |
| Door | Robosuite 1.4 (test) | IQM291 | 12 | |
| Wipe | Robosuite 1.4 (test) | IQM74.1 | 12 | |
| Mug Cleanup | Robosuite Unseen views | Success Rate0.2785 | 9 | |
| Mug Cleanup | Robosuite Seen views | Success Rate56.75 | 9 | |
| Coffee | Robosuite Unseen views | Success Rate12.65 | 9 | |
| Coffee | Robosuite Seen views | Success Rate63 | 9 | |
| Stack Three | Robosuite Unseen views | Success Rate53.65 | 9 | |
| Stack Three | Robosuite Seen views | Success Rate69 | 9 | |
| Square | Robosuite Unseen views | Success Rate19.8 | 9 | |
| Square | Robosuite Seen views | Success Rate69 | 9 | |
| Lift | Robosuite Unseen views | Success Rate94.7 | 9 | |
| Lift | Robosuite Seen views | Success Rate99.5 | 9 | |
| Continuous Control | Robosuite Table Wiping | Final Reward76.6 | 7 | |
| Continuous Control | Robosuite Door Opening | Final Reward216.6 | 7 | |
| Robotic Manipulation | Robosuite (test) | Three Piece Success86 | 6 | |
| Robotic Manipulation | Robosuite | Lift Success Rate100 | 4 | |
| Robotic Manipulation | Robosuite Door | Mean Episode Return210.37 | 4 | |
| Robotic Manipulation | Robosuite Lift | Mean Episode Return305.44 | 4 | |
| threading | RoboSuite (out-of-distribution) | Success Rate49 | 3 | |
| stack | RoboSuite (out-of-distribution) | Success Rate72 | 3 | |
| Stack | Robosuite IIWA (Robotiq140) few-shot transfer | Success Rate4.7 | 2 | |
| Stack | Robosuite Kinova (Robotiq85) few-shot transfer | Success Rate5.3 | 2 |
Showing 25 of 34 rows