ManiSkill
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Robotic Manipulation | ManiSkill3 | Stack Cube Success Rate94.3 | 15 | |
| Training Throughput Measurement | ManiSkill | Training Throughput436.32 | 15 | |
| Hang | ManiSkill2 | Success Rate28.4 | 14 | |
| Fill | ManiSkill2 | Success Rate29.6 | 14 | |
| PickYCB | ManiSkill 2 | Success Rate50.4 | 14 | |
| PickCube | ManiSkill2 | Success Rate85.6 | 14 | |
| StackCube | ManiSkill 2 | Success Rate88 | 14 | |
| PushChair | ManiSkill2 | Score45 | 12 | |
| TurnFaucet | ManiSkill2 | Score22 | 12 | |
| Stack Cube | ManiSkill | Success Rate86 | 11 | |
| Pick Cube | ManiSkill | Success Rate99.2 | 11 | |
| Robot Manipulation | ManiSkill Semantics Generalization 3 (Unseen simulation tasks) | Object OOD Score65 | 8 | |
| Robot Manipulation | ManiSkill Vision Generalization 3 (Unseen simulation tasks) | Success Rate (Table)90 | 8 | |
| Robot Manipulation | ManiSkill Execution Generalization 3 (Unseen simulation tasks) | Object Position Error23.75 | 8 | |
| Humanoid Robot Manipulation | ManiSkill2 | Push Chair Score16.47 | 8 | |
| Failure Detection and Reasoning | Maniskill | Detection Accuracy78.8 | 6 | |
| SetTable - OpenFridge | ManiSkill-HAB | Success Rate0.6627 | 6 | |
| SetTable - Place | ManiSkill HAB | Success Rate58.63 | 6 | |
| SetTable - Pick | ManiSkill-HAB | Success Rate26.29 | 6 | |
| TidyHouse - Pick | ManiSkill-HAB | Success Rate0.1786 | 6 | |
| Prep Groceries - Place | ManiSkill-HAB | Success Rate35.81 | 6 | |
| Prep Groceries - Pick | ManiSkill-HAB | Success Rate12.01 | 6 | |
| Cross-Embodiment Transfer | ManiSkill Simulation 50-Shot | Transfer Success Rate75 | 5 | |
| Cross-Embodiment Transfer | ManiSkill Simulation 10-Shot | Transfer Success Rate60.33 | 5 | |
| Cross-Embodiment Transfer | ManiSkill Simulation 5-Shot | Transfer Success Rate54.33 | 5 |
Showing 25 of 33 rows