IsaacSim
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| ObjectNav | IsaacSim (Ihlen) unseen objects (test) | Collision Rate0 | 12 | |
| ObjectNav | IsaacSim Beechwood unseen objects (test) | Completion Rate720 | 12 | |
| ObjectNav | IsaacSim Chemistry unseen objects (test) | Completion Rate (CR)4.4 | 12 | |
| Peg Insertion | IsaacSim Peg Insertion adapted from Nvidia Factory (test) | Success Rate86 | 8 | |
| Gear Meshing | IsaacSim Gear Meshing adapted from Nvidia Factory (test) | Success Rate86 | 8 | |
| Nut Threading | IsaacSim Nut Threading adapted from Nvidia Factory (test) | Success Rate100 | 8 | |
| Tool Pusher Tool Using | IsaacSim | Success Rate3 | 6 | |
| Tool Hook Tool Using | IsaacSim | Success Rate6 | 6 | |
| Slot Extrinsic Dexterity | IsaacSim | Success Rate9 | 6 | |
| Slope Extrinsic Dexterity | IsaacSim | Success Rate50 | 6 | |
| Wall Extrinsic Dexterity | IsaacSim | Success Rate80 | 6 | |
| Edge Extrinsic Dexterity | IsaacSim | Success Rate60 | 6 | |
| Book Alignment | IsaacSim | Success Rate7 | 6 | |
| Box Alignment | IsaacSim | Success Rate90 | 6 | |
| Exploration | IsaacSim Ihlen (unseen) | FCR0.139 | 4 | |
| Exploration | IsaacSim Beechwood (unseen) | Failure Case Rate (FCR)39.2 | 4 | |
| Exploration | IsaacSim Chemistry (unseen) | FCR34.3 | 4 |
Showing 17 of 17 rows