Franka
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Failure Detection | Franka unseen | Brier Score0.215 | 11 | |
| Failure Detection | Franka seen | Brier Score0.15 | 11 | |
| Scoop-beads-with-spoon | Franka Real-world | Success Rate80 | 8 | |
| Sweep-salad-off-the-board | Franka Real-world Dataset | Success Rate55 | 8 | |
| Put-radish-in-pot | Franka Real-world | Success Rate95 | 8 | |
| Visual-goal motion planning | Franka Avg. 1.0 (test) | Success Rate (SR)75.2 | 4 | |
| Visual-goal motion planning | Franka 2.5 rad bin 1.0 (test) | Success Rate44.7 | 4 | |
| Visual-goal motion planning | Franka 2.0 rad bin 1.0 (test) | Success Rate (SR)67.7 | 4 | |
| Visual-goal motion planning | Franka 1.5 rad bin 1.0 (test) | Success Rate81.7 | 4 | |
| Visual-goal motion planning | Franka rad bin 1.0 (test) | Success Rate89 | 4 | |
| Visual-goal motion planning | Franka 0.5 rad bin 1.0 (test) | Success Rate (SR)93 | 4 | |
| Pour Balls | Franka Real-world Environment | Success Rate55 | 4 | |
| Close Drawer | Franka Real-world Environment | Success Rate90 | 4 | |
| Dynamics Prediction | Franka | MAE7.737 | 4 | |
| Robot Manipulation | Real-world Franka | PlaceToy Success Rate25 | 4 | |
| Robot Manipulation | Franka Real-world Individual Tasks (real-robot) | Pick Bread Success Rate80 | 4 | |
| Long-horizon Robot Manipulation | Franka Real-world Long-horizon Tasks (real-robot) | Average Length2 | 2 |
Showing 17 of 17 rows