ManiSkill
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Robotic Manipulation | ManiSkill3 | Average Success Rate96.4 | 33 | |
| Stack | ManiSkill 3 | Success at End95.2 | 25 | |
| Robot Manipulation | ManiSkill PullCube v1 | Success Rate95.9 | 22 | |
| Robot Manipulation | ManiSkill Table-Top 2 Finger Gripper (Overall) | Success Rate70.6 | 16 | |
| Robot Manipulation | ManiSkill RollBall v1 | Success Rate37 | 16 | |
| Robot Manipulation | ManiSkill PokeCube v1 | Success Rate76.5 | 16 | |
| Robot Manipulation | ManiSkill PushCube v1 | Success Rate91.2 | 16 | |
| VLA Training Throughput (pi_0) | ManiSkill | Training Throughput436.32 | 15 | |
| Training Throughput Measurement | ManiSkill | Training Throughput436.32 | 15 | |
| Hang | ManiSkill2 | Success Rate28.4 | 14 | |
| Fill | ManiSkill2 | Success Rate29.6 | 14 | |
| PickYCB | ManiSkill 2 | Success Rate50.4 | 14 | |
| PickCube | ManiSkill2 | Success Rate85.6 | 14 | |
| StackCube | ManiSkill 2 | Success Rate88 | 14 | |
| Robot manipulation | ManiSkill (Out-Of-Distribution) | Vision Score81.7 | 12 | |
| PushChair | ManiSkill2 | Score45 | 12 | |
| TurnFaucet | ManiSkill2 | Score22 | 12 | |
| Robotic Manipulation | ManiSkill2 | PickCube Success Rate92 | 11 | |
| Stack Cube | ManiSkill | Success Rate86 | 11 | |
| Pick Cube | ManiSkill | Success Rate99.2 | 11 | |
| Poke | ManiSkill3 | Success Rate (At End)76.6 | 10 | |
| Single-Arm Manipulation | ManiSkill3 (Out-Of-Distribution) | Vision Score95.6 | 10 | |
| Single-Arm Manipulation | ManiSkill3 In-Distribution | Success Rate97.7 | 10 | |
| Closed-loop Performance | ManiSkill | Latency (ms)1 | 10 | |
| Robotic Manipulation | ManiSkill | Average Success Rate89.8 | 10 |
Showing 25 of 339 rows
...