iTHOR
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| 1-Phase Room Rearrangement | iTHOR challenge 2021 (test) | FS (Final Success)0.9653 | 14 | |
| ObjectNav | iTHOR Unseen class (14/8) | Success Rate87 | 5 | |
| ObjectNav | iTHOR Seen class (14/8) | Success Rate84.7 | 5 | |
| ObjectNav | iTHOR Unseen class (18/4) | SR95 | 5 | |
| ObjectNav | iTHOR Seen class (18/4) | Success Rate (SR)88.7 | 5 | |
| 3D Scene Reconstruction | iTHOR (FloorPlan229) | Accuracy93.1 | 4 | |
| 3D Scene Reconstruction | iTHOR (FloorPlan225) | Accuracy88.8 | 4 | |
| 3D Scene Reconstruction | iTHOR FloorPlan220 | Accuracy89.1 | 4 | |
| 3D Scene Reconstruction | iTHOR (FloorPlan213) | Accuracy93.9 | 4 | |
| 3D Scene Reconstruction | iTHOR FloorPlan210 | Accuracy93.3 | 4 | |
| 3D Scene Reconstruction | iTHOR FloorPlan207 | Accuracy92 | 4 | |
| Hierarchical Reward Design | iTHOR | HL Reward14.19 | 3 |
Showing 12 of 12 rows