Simulation
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Image Matching | Simulation | MS42 | 38 | |
| DR estimation | Simulation configuration (ii) imbalanced scenario 2 (heterogeneous) | Bias-0.029 | 27 | |
| DR estimation | Simulation configuration (ii) imbalanced scenario 1 (homogeneous) | Bias-0.035 | 27 | |
| Verification | Simulation Distribution Shift (test) | AUC88.3 | 18 | |
| Verification | Simulation In Distribution (test) | AUC95 | 18 | |
| Insertion | Simulation | Insertion Success Rate98.2 | 14 | |
| Image Deblurring | Simulation | PSNR39.23 | 12 | |
| Push | Simulation | Success Rate98.7 | 10 | |
| Passive mapping | Simulation (test) | F1 Score81.8 | 10 | |
| Grasp Pose Estimation | Simulation Novel Objects | SR@164.7 | 8 | |
| Grasp Pose Estimation | Simulation Similar Objects | SR@164 | 8 | |
| Drawer Open | Simulation 1.0 (test) | Success Rate95.3 | 8 | |
| Plate on Rack | Simulation 1.0 (test) | Success Rate92.7 | 8 | |
| Mug on Plate | Simulation 1.0 (test) | Success Rate95.3 | 8 | |
| Pen in Container | Simulation 1.0 (test) | Success Rate51.3 | 8 | |
| Screwdriver in Caddy | Simulation 1.0 (test) | Success Rate98 | 8 | |
| Can Opener in Caddy | Simulation 1.0 (test) | Success Rate94 | 8 | |
| Unplug Charger | Simulation | Success Rate58 | 7 | |
| Take Umbrella | Simulation | Success Rate64 | 7 | |
| Pick Up Cup | Simulation | Success Rate0.7 | 7 | |
| Phone On Base | Simulation | Success Rate92 | 7 | |
| Put Box In Bin | Simulation with Disturbance | Success Rate60 | 7 | |
| Put Box In Cabinet | Simulation | Success Rate0.5 | 7 | |
| Bimanual Insertion | Simulation | Success Rate54 | 7 | |
| Lift | Simulation Cylinder Shape | Success Rate97.8 | 7 |
Showing 25 of 77 rows