Real Robot
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Real-robot Manipulation | Real-robot Seen tasks | Stack Bowl Success Rate80 | 6 | |
| Real-robot Manipulation | Real-robot Novel tasks OOD | Place Block Success Rate50 | 5 | |
| Robust Manipulation | Real Robot Robust Suite | Success Rate61.7 | 4 | |
| Precise Placement and Arrangement | Real Robot Spatial Suite | Success Rate78.3 | 4 | |
| Multi-step Sequential Manipulation | Real Robot Long-Horizon Suite | Success Rate65 | 4 | |
| Bimanual Coordination | Real Robot Bimanual Suite | Success Rate66.7 | 4 | |
| Vision-and-Language Navigation | Real Robot TurtleBot 4 Lite, 20 instructions 1.0 (test) | Success Rate (SR)30 | 4 | |
| Stacking Puzzle | Real-Robot | Success Rate56 | 4 | |
| Mug Replacement | Real-Robot | Success Rate6,000 | 4 | |
| Marshmallows | Real-Robot | Success Rate65 | 4 | |
| Drawer Search | Real-Robot | Success Rate0.333 | 4 | |
| Multi-task robotic manipulation | Real Robot 20 tasks | Success Rate91 | 4 | |
| Stack Blocks | Real Robot ID 1.0 (test) | Success Rate90 | 3 | |
| Pour Tea | Real Robot ID 1.0 (test) | Success Rate90 | 3 | |
| Press Button | Real Robot ID 1.0 (test) | Success Rate100 | 3 | |
| Open | Real Robot | Success Rate70 | 3 | |
| Place | Real Robot | Success Rate8 | 3 | |
| Ham. | Real Robot | Success Rate40 | 3 | |
| Press | Real Robot | Success Rate80 | 3 | |
| Stack | Real Robot | Success Rate7 | 3 | |
| Grasp | Real Robot | Success Rate83 | 3 | |
| Cloth Folding | Real-robot Franka Emika Panda (real-world) | Success Rate30 | 3 | |
| Table Organization | Real-robot Franka Emika Panda (real-world) | Success Rate20 | 3 | |
| Shoe Alignment | Real-robot Franka Emika Panda (real-world) | Success Rate80 | 3 | |
| Block Stacking | Real-robot Franka Emika Panda (real-world) | Success Rate50 | 3 |
Showing 25 of 49 rows