Real-world Robot Experiments
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| pick toy | Real-World Robot Experiments v1 (test) | Success Rate (ID)100 | 24 | |
| insert flower | Real-World Robot Experiments v1 (test) | Success Rate (In-Distribution)55 | 12 | |
| fold towel | Real-World Robot Experiments v1 (test) | Success Rate (In-Distribution)65 | 12 | |
| stack cups | Real-World Robot Experiments v1 (test) | Success Rate (In-Distribution)55 | 12 | |
| rank cubes | Real-World Robot Experiments v1 (test) | Success Rate (In-Distribution)70 | 12 | |
| erase symbol | Real-World Robot Experiments v1 (test) | Success Rate (ID)70 | 12 | |
| stack cubes | Real-World Robot Experiments v1 (test) | Success Rate (In-Distribution)75 | 12 | |
| stack bowl | Real-World Robot Experiments v1 (test) | Success Rate (ID)80 | 12 | |
| open drawer | Real-World Robot Experiments v1 (test) | Success Rate (In-Distribution)100 | 12 | |
| Robot Manipulation | Real-world Robot Experiments (test) | Success Rate: Push chair95 | 9 | |
| Open Door | Real-world robot experiments kitchen | Success Rate70 | 6 | |
| Pick-and-Place | Real-world robot experiments kitchen | Success Rate82 | 6 | |
| Pick-and-Place | Real-world robot experiments easy | Success Rate86 | 6 | |
| Reaching | Real-world robot experiments kitchen | Success Rate84 | 6 | |
| Reaching | Real-world robot experiments easy | Success Rate90 | 6 | |
| Detour Rerouting | Real-world robot experiments | Success Rate6 | 5 | |
| Structural Clues | Real-world robot experiments | Success Rate7 | 5 | |
| Sign Understanding | Real-world robot experiments | Success Rate0.875 | 5 | |
| Robotic Manipulation | Real-world robot experiments 15° Viewpoint Shift | Success Rate (Basket Upright)48.3 | 4 | |
| Robotic Manipulation | Real-world robot experiments 10° Viewpoint Shift | Basket Upright Success Rate73.3 | 4 | |
| Robotic Manipulation | Real-world robot experiments 5° Viewpoint Shift | Basket Upright Success Rate100 | 4 | |
| Robotic Manipulation | Real-world robot experiments 0° Viewpoint Shift | Basket Upright Success Rate96.7 | 4 | |
| Robot Manipulation (Slip Ring) | Real-World Robot Experiments | Success Rate70 | 4 | |
| Robot Manipulation (Clean Table) | Real-World Robot Experiments | Success Rate75 | 4 | |
| Robot Manipulation (Place Bottle) | Real-World Robot Experiments | Success Rate80 | 4 |
Showing 25 of 31 rows