ManiSkill
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Robotic Manipulation | ManiSkill3 | Average Success Rate96.4 | 28 | |
| VLA Training Throughput (pi_0) | ManiSkill | Training Throughput436.32 | 15 | |
| Training Throughput Measurement | ManiSkill | Training Throughput436.32 | 15 | |
| Hang | ManiSkill2 | Success Rate28.4 | 14 | |
| Fill | ManiSkill2 | Success Rate29.6 | 14 | |
| PickYCB | ManiSkill 2 | Success Rate50.4 | 14 | |
| PickCube | ManiSkill2 | Success Rate85.6 | 14 | |
| StackCube | ManiSkill 2 | Success Rate88 | 14 | |
| Robot manipulation | ManiSkill (Out-Of-Distribution) | Vision Score81.7 | 12 | |
| PushChair | ManiSkill2 | Score45 | 12 | |
| TurnFaucet | ManiSkill2 | Score22 | 12 | |
| Robotic Manipulation | ManiSkill2 | PickCube Success Rate92 | 11 | |
| Stack Cube | ManiSkill | Success Rate86 | 11 | |
| Pick Cube | ManiSkill | Success Rate99.2 | 11 | |
| Single-Arm Manipulation | ManiSkill3 (Out-Of-Distribution) | Vision Score95.6 | 10 | |
| Single-Arm Manipulation | ManiSkill3 In-Distribution | Success Rate97.7 | 10 | |
| Closed-loop Performance | ManiSkill | Latency (ms)1 | 10 | |
| Robot manipulation | ManiSkill In-Distribution | Success Rate90.9 | 9 | |
| Robotic Manipulation | ManiSkill2 StackCube (hybrid composition) | Violation0.4 | 8 | |
| Simulation Throughput Evaluation | ManiSkill OpenVLA-OFT | Throughput250.9 | 8 | |
| Simulation Throughput Evaluation | ManiSkill π0.5 | Throughput376 | 8 | |
| Behavioral transition detection | ManiSkill | Stage 0 Score (S0)86.8 | 8 | |
| Robot Manipulation | ManiSkill In-Distribution (test) | Success Rate97.4 | 8 | |
| Mobile manipulation | ManiSkill-HAB (simulation) | Pick Apple Fridge Success Rate33.3 | 8 | |
| Robot Manipulation | ManiSkill (test) | Peg Insertion Side SR24 | 8 |
Showing 25 of 295 rows
...