ManiSkill
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Robotic Manipulation | ManiSkill3 | Average Success Rate96.4 | 21 | |
| VLA Training Throughput (pi_0) | ManiSkill | Training Throughput436.32 | 15 | |
| Training Throughput Measurement | ManiSkill | Training Throughput436.32 | 15 | |
| Hang | ManiSkill2 | Success Rate28.4 | 14 | |
| Fill | ManiSkill2 | Success Rate29.6 | 14 | |
| PickYCB | ManiSkill 2 | Success Rate50.4 | 14 | |
| PickCube | ManiSkill2 | Success Rate85.6 | 14 | |
| StackCube | ManiSkill 2 | Success Rate88 | 14 | |
| Robot manipulation | ManiSkill (Out-Of-Distribution) | Vision Score81.7 | 12 | |
| PushChair | ManiSkill2 | Score45 | 12 | |
| TurnFaucet | ManiSkill2 | Score22 | 12 | |
| Stack Cube | ManiSkill | Success Rate86 | 11 | |
| Pick Cube | ManiSkill | Success Rate99.2 | 11 | |
| Closed-loop Performance | ManiSkill | Latency (ms)1 | 10 | |
| Robot manipulation | ManiSkill In-Distribution | Success Rate90.9 | 9 | |
| Behavioral transition detection | ManiSkill | Stage 0 Score (S0)86.8 | 8 | |
| Robot Manipulation | ManiSkill In-Distribution (test) | Success Rate97.4 | 8 | |
| Mobile manipulation | ManiSkill-HAB (simulation) | Pick Apple Fridge Success Rate33.3 | 8 | |
| Robot Manipulation | ManiSkill (test) | Peg Insertion Side SR24 | 8 | |
| Complex Robot Manipulation | ManiSkill | Insert Success Rate24 | 8 | |
| Robot Manipulation | ManiSkill Semantics Generalization 3 (Unseen simulation tasks) | Object OOD Score65 | 8 | |
| Robot Manipulation | ManiSkill Vision Generalization 3 (Unseen simulation tasks) | Success Rate (Table)90 | 8 | |
| Robot Manipulation | ManiSkill Execution Generalization 3 (Unseen simulation tasks) | Object Position Error23.75 | 8 | |
| Humanoid Robot Manipulation | ManiSkill2 | Push Chair Score16.47 | 8 | |
| Regime Change Detection and Adaptation | ManiSkill 300 steps (extended episodes) | Detection Accuracy (%)100 | 7 |
Showing 25 of 273 rows
...