| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Gibson (val) | Success Rate95.77 | 22 | 4mo ago | ||
| HM3D OVON (val unseen) | MTU3D | Success Rate (SR)40.8 | 12 | 27d ago | |
| IsaacSim (Ihlen) unseen objects (test) | AION-e & MJO | Collision Rate0 | 12 | 5mo ago | |
| IsaacSim Beechwood unseen objects (test) | AION-e & MJO | Completion Rate720 | 12 | 5mo ago | |
| IsaacSim Chemistry unseen objects (test) | AION-e & SSNet | Completion Rate (CR)4.4 | 12 | 5mo ago | |
| HM3D v0.1 (val) | Success Rate (SR)70.4 | 9 | 2mo ago | ||
| iTHOR Unseen class (14/8) | AION-g | Success Rate87 | 5 | 5mo ago | |
| iTHOR Seen class (14/8) | AION-g | Success Rate84.7 | 5 | 5mo ago | |
| iTHOR Unseen class (18/4) | AION-g | SR95 | 5 | 5mo ago | |
| iTHOR Seen class (18/4) | AION-g | Success Rate (SR)88.7 | 5 | 5mo ago | |
| GOAT-Bench (val-seen) | ThreeDiff | SR34.5 | 4 | 1mo ago | |
| FloVerse-1.6K (test) | ThreeDiff | Success Rate (SR)28.6 | 2 | 1mo ago |