Simulation Benchmark
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Long-horizon manipulation | Simulation Benchmark | Retrieve Object Success Rate (Spatial)68 | 8 | |
| Goal-conditioned Navigation | Simulation Benchmark | Goal Reached Rate61 | 8 | |
| Closed-loop long-horizon navigation | simulation benchmark | NIR21.2 | 7 | |
| Functional Tool-Use | Simulation Benchmark unseen tools | SR (Scoop S01)30 | 4 | |
| Overall manipulation success | Simulation Benchmark Overall OOD | Success Rate71 | 4 | |
| Overall manipulation success | Simulation Benchmark Overall ID | Success Rate63 | 4 | |
| PrepareTable manipulation | Simulation Benchmark PrepareTable OOD | Success Rate72 | 4 | |
| PrepareTable manipulation | Simulation Benchmark PrepareTable S1 | Success Rate60 | 4 | |
| HangMugTree manipulation | Simulation Benchmark HangMugTree OOD | Success Rate60 | 4 | |
| PourInBowl manipulation | Simulation Benchmark PourInBowl OOD | Success Rate80 | 4 | |
| PourInBowl manipulation | Simulation Benchmark PourInBowl S2 | Success Rate56 | 4 | |
| Active Exploration and Grasping | Simulation Benchmark Level 4 | TFT (s)131.4 | 4 | |
| Active Exploration and Grasping | Simulation Benchmark Level 3 | Time to First Touch (s)95 | 4 | |
| Active Exploration and Grasping | Simulation Benchmark Level 2 | TFT (s)133.9 | 4 | |
| Active Exploration and Grasping | Simulation Benchmark Level 1 | TFT (s)83.5 | 4 |
Showing 15 of 15 rows