Real-world Robot Manipulation
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| PnP-Box | Real-world robot manipulation Static (OOD) | Success Rate92 | 14 | |
| Robot Manipulation | Real-world Robot Manipulation Average | Success Rate56 | 10 | |
| Robot Manipulation | Real-world Robot Manipulation Novel Object | Success Rate86.7 | 9 | |
| Hang Cup | Real-world robot manipulation Static (OOD) | Success Rate90 | 7 | |
| Hang Tape | Real-world robot manipulation Static (OOD) | Success Rate88 | 7 | |
| Pour Water | Real-world robot manipulation Static (OOD) | Success Rate90 | 7 | |
| Open Drawer | Real-world robot manipulation Static (OOD) | Success Rate92 | 7 | |
| Pick-and-Place | Real-world robot manipulation unseen tasks | Average Success Rate66.7 | 7 | |
| PnP-Box | Real-world robot manipulation Static (ID) | Success Rate76 | 6 | |
| Can on Plate | Real-world Robot Manipulation 1.0 (test) | Success Rate100 | 6 | |
| Wipe Brush | Real-world Robot Manipulation 1.0 (test) | Success Rate75 | 6 | |
| Bottle from Rack | Real-world Robot Manipulation 1.0 (test) | Success Rate0.85 | 6 | |
| Pour Mug | Real-world Robot Manipulation 1.0 (test) | Success Rate20 | 6 | |
| Rotate Box | Real-world Robot Manipulation 1.0 (test) | Success Rate20 | 6 | |
| Drawer Closing | Real-world robot manipulation | Success Rate75 | 6 | |
| Poking | Real-world robot manipulation unseen tasks | Hippo Performance70 | 5 | |
| Robot Manipulation | Real-world Robot Manipulation Seen Objects, Unseen Instructions | Success Rate38.3 | 5 | |
| Robot Manipulation | Real-world Robot Manipulation Seen Objects, Unseen Combinations | Success Rate59.1 | 5 | |
| Robot Manipulation | Real-world Robot Manipulation Total | Success Rate79.2 | 5 | |
| Place Starbucks | Real-world Robot Manipulation (test) | Success Rate36 | 4 | |
| Lift Up Bottle | Real-world Robot Manipulation (test) | Success Rate68 | 4 | |
| Place Mandarin | Real-world Robot Manipulation (test) | Success Rate84 | 4 | |
| Novel objects manipulation | Real-world Robot Manipulation Generalization v1 (test) | Success Rate75 | 4 | |
| Instruction following | Real-world Robot Manipulation Generalization v1 (test) | Success Rate80 | 4 | |
| Pour water into bowl | Real-world Robot Manipulation Fundamental v1 (test) | Success Rate90 | 4 |
Showing 25 of 49 rows