Franka
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Failure Detection | Franka unseen | Brier Score0.215 | 11 | |
| Failure Detection | Franka seen | Brier Score0.15 | 11 | |
| Scoop-beads-with-spoon | Franka Real-world | Success Rate80 | 8 | |
| Sweep-salad-off-the-board | Franka Real-world Dataset | Success Rate55 | 8 | |
| Put-radish-in-pot | Franka Real-world | Success Rate95 | 8 | |
| Tabletop pick-and-place | Franka | Task Success Rate (SRtask)67 | 5 | |
| Drawer opening | Franka | Task Success Rate99.5 | 5 | |
| External joint torque estimation | Franka Free-space setting | L1 Error (Nm)0 | 5 | |
| World modeling | Franka (test) | FVD421.9 | 4 | |
| Robot Manipulation | Franka Deployment Real-world Low-light | Success Rate70 | 4 | |
| Robot Manipulation | Franka Normal lighting (real-world deployment) | Success Rate75 | 4 | |
| Translate T-block | Franka Real-World Robot Evaluation | Success Rate8 | 4 | |
| External joint torque estimation | Franka Contact setting | L1 Error (Nm)0 | 4 | |
| Sweep task | Real-world Franka | Success Rate14 | 4 | |
| Visual-goal motion planning | Franka Avg. 1.0 (test) | Success Rate (SR)75.2 | 4 | |
| Visual-goal motion planning | Franka 2.5 rad bin 1.0 (test) | Success Rate44.7 | 4 | |
| Visual-goal motion planning | Franka 2.0 rad bin 1.0 (test) | Success Rate (SR)67.7 | 4 | |
| Visual-goal motion planning | Franka 1.5 rad bin 1.0 (test) | Success Rate81.7 | 4 | |
| Visual-goal motion planning | Franka rad bin 1.0 (test) | Success Rate89 | 4 | |
| Visual-goal motion planning | Franka 0.5 rad bin 1.0 (test) | Success Rate (SR)93 | 4 | |
| Pour Balls | Franka Real-world Environment | Success Rate55 | 4 | |
| Close Drawer | Franka Real-world Environment | Success Rate90 | 4 | |
| Dynamics Prediction | Franka | MAE7.737 | 4 | |
| Robot Manipulation | Real-world Franka | PlaceToy Success Rate25 | 4 | |
| Robot Manipulation | Franka Real-world Individual Tasks (real-robot) | Pick Bread Success Rate80 | 4 |
Showing 25 of 28 rows