Habitat
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| TP | Habitat | ASR98 | 20 | |
| QA | Habitat | ASR98 | 10 | |
| Image-Goal Navigation | Habitat MP3D | Success Rate (SR)78.95 | 5 | |
| Object Navigation | Habitat 2020 (test-challenge) | SPL0.102 | 5 | |
| Autonomous Object Search | Habitat Env. 2 3.0 | Success Rate99 | 4 | |
| Autonomous Object Search | Habitat Env. 1 3.0 | Success Rate100 | 4 | |
| Active Recognition | Habitat Open classes | Top-1 Acc28 | 4 | |
| Active Recognition | Habitat 15 novel classes | Top-1 Accuracy35.4 | 4 | |
| Active Recognition | Habitat 10 base classes | Top-1 Accuracy25.8 | 4 | |
| Manipulation | Habitat Pick | Success Rate82.5 | 3 | |
| Navigation | Habitat Nav | Success Rate72 | 2 | |
| Rearrange | Habitat Rearrange Easy challenge 2.0 (val) | Success Rate26.4 | 2 | |
| Rearrange | Habitat 2.0 (train) | Success Rate36.7 | 2 |
Showing 13 of 13 rows