HM3D
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Object Goal Navigation | HM3D | Success Rate100 | 55 | |
| Backward Visual Navigation (To Start) | HM3D | SR96.1 | 48 | |
| Object Goal Navigation | HM3D v1 (val) | Success Rate (SR)76 | 34 | |
| Object Navigation | HM3D v1 (val) | SR79.1 | 32 | |
| Open-set ObjectGoal Navigation | HM3D-OVON unseen (val) | SR53.8 | 28 | |
| Forward Visual Navigation (To End) | HM3D | Success Rate (SR)100 | 24 | |
| Any-Point Visual Navigation | HM3D | SR94.1 | 24 | |
| open-vocabulary object goal navigation | HM3D-OVON (val-seen) | SR59.2 | 21 | |
| Object Goal Navigation | HM3D (val) | SR84.8 | 21 | |
| Novel View Synthesis | HM3D | PSNR28.293 | 21 | |
| Object Navigation | HM3D v2 (val) | SR83 | 19 | |
| Object Goal Navigation | HM3D 0.1 | SR68 | 18 | |
| Instance Image-Goal Navigation | HM3D v3 (val) | Success Rate (SR)78.5 | 15 | |
| Multi-View Pose Estimation | HM3D supervised (test) | RRE0 | 15 | |
| Object Navigation | HM3D Challenge (test) | Success Rate65 | 14 | |
| Object Navigation | HM3D ObjNav | Success Rate (SR)63 | 13 | |
| Zero-Shot Object Navigation | HM3D v1 | SR80 | 12 | |
| Multi-View Stereo Reconstruction | HM3D (test) | ND1 | 12 | |
| Object Goal Navigation | HM3D OVON | SR47.3 | 11 | |
| Image-goal navigation | HM3D (test) | Success Rate76.1 | 10 | |
| Object-goal navigation | HM3D Habitat 2022 ObjectNav challenge (val) | Success Rate (SR)54.4 | 9 | |
| Ordinal Consistency Evaluation | HM3D Habitat (val) | Kendall's Tau (20 steps)0.82 | 8 | |
| Ordinal Consistency | HM3D | Kendall Tau (20 steps)0.81 | 8 | |
| Instance-Image-Goal Navigation | HM3D | SR60.2 | 8 | |
| Image Goal Navigation | HM3D Instance ImageNav (test) | SR60.8 | 8 |
Showing 25 of 42 rows