EmbodiedBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Embodied AI | EmbodiedBench EB-Habitat | Base Score98.5 | 53 | |
| Embodied AI task execution | EmbodiedBench EB-ALFRED | Average Success Rate86.69 | 24 | |
| Vision-Language Navigation | EmbodiedBench Navigation latest (test) | Success Rate86.7 | 23 | |
| Embodied Task Success | EmbodiedBench EB-Navigation 1.0 (test) | Average Success Rate61.33 | 14 | |
| Embodied Task Success | EmbodiedBench EB-Habitat 1.0 (test) | Average Task Success52.33 | 14 | |
| Embodied AI Task Success | EmbodiedBench Navigation | Success Rate (Base Task)62.5 | 10 | |
| Embodied AI Task Success | EmbodiedBench Habitat | Success Rate (Base Task)96.67 | 10 | |
| Robot Manipulation | EmbodiedBench Spatial | Success Rate45.8 | 6 | |
| Navigation | EmbodiedBench Vanilla | Base Success Rate71.7 | 4 | |
| Manipulation Task | EmbodiedBench Vanilla | Base Score28.3 | 4 | |
| High-level task planning and completion | EmbodiedBench (Alfred) | Base Score24.7 | 4 |
Showing 11 of 11 rows