Habitat
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Active mapping of moving 3D objects | Habitat Gibson and Matterport3D scenes | Coverage86.93 | 112 | |
| TP | Habitat | ASR98 | 20 | |
| QA | Habitat | ASR98 | 10 | |
| Dialogue-Driven Social Navigation | Habitat 3.0c | Success Rate78 | 6 | |
| Room Prediction | Habitat Scene 69 1.0 (test) | Time Found33 | 6 | |
| Active embodied question answering | Habitat HM3D (val) | Score30.59 | 5 | |
| Active recognition | Habitat MP3D | Success Rate (SR)23.88 | 5 | |
| Image-goal navigation | Habitat HM3D (val) | Success Rate (SR)45.07 | 5 | |
| Image-Goal Navigation | Habitat MP3D | Success Rate (SR)78.95 | 5 | |
| Object Navigation | Habitat 2020 (test-challenge) | SPL0.102 | 5 | |
| Sparse 360° views-to-video generation | Habitat | FVD450.696 | 4 | |
| Autonomous Object Search | Habitat Env. 2 3.0 | Success Rate99 | 4 | |
| Autonomous Object Search | Habitat Env. 1 3.0 | Success Rate100 | 4 | |
| Active Recognition | Habitat Open classes | Top-1 Acc28 | 4 | |
| Active Recognition | Habitat 15 novel classes | Top-1 Accuracy35.4 | 4 | |
| Active Recognition | Habitat 10 base classes | Top-1 Accuracy25.8 | 4 | |
| Room Prediction | Habitat Scene 573 1.0 (test) | Tfind47 | 3 | |
| Room Prediction | Habitat Scene 871 1.0 (test) | Tfind258 | 3 | |
| Room Prediction | Habitat Scene 853 1.0 (test) | Tfind Score345 | 3 | |
| Manipulation | Habitat Pick | Success Rate82.5 | 3 | |
| Dialogue-Driven Social Navigation | Habitat 3.0 | Success Rate (S)91 | 2 | |
| Navigation | Habitat Nav | Success Rate72 | 2 | |
| Rearrange | Habitat Rearrange Easy challenge 2.0 (val) | Success Rate26.4 | 2 | |
| Rearrange | Habitat 2.0 (train) | Success Rate36.7 | 2 |
Showing 24 of 24 rows