REVERIE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Vision-and-Language Navigation | REVERIE (val unseen) | SPL53.2 | 237 | |
| Vision-and-Language Navigation | REVERIE unseen (test) | Success Rate (SR)81.5 | 110 | |
| Vision-and-Language Navigation | REVERIE seen (val) | SR84.33 | 64 | |
| Navigation | REVERIE Unseen (test) | SR81.51 | 51 | |
| Navigation | REVERIE (val unseen) | Success Rate (SR)62.4 | 42 | |
| Remote Object Grounding | REVERIE (test unseen) | OSR62.22 | 38 | |
| Remote Object Grounding | REVERIE (val unseen) | OSR61.09 | 38 | |
| Remote Grounding | REVERIE (val seen) | RGSPL71.05 | 37 | |
| Remote Grounding | REVERIE unseen (test) | RGS77.84 | 33 | |
| Vision-and-Language Navigation | REVERIE (test) | SPL3,606 | 30 | |
| Vision-Language Navigation | REVERIE-AIM (val-unseen) | ONS@0.1m50.4 | 25 | |
| Remote Grounding | REVERIE unseen (val) | RGS34.51 | 22 | |
| Remote Embodied Visual Referencing | REVERIE unseen 1.0 (val) | RGS22.41 | 15 | |
| Remote Embodied Visual Referencing | REVERIE 1.0 (val seen) | Succ.61.91 | 15 | |
| Navigation | REVERIE (val seen) | Success Rate (SR)50.53 | 14 | |
| Vision-and-Language Navigation | REVERIE CE (val unseen) | NE4.9 | 13 | |
| Vision-and-Language Navigation | REVERIE Unseen Discrete (val) | OSR63.9 | 10 | |
| Vision-Language Navigation | REVERIE | Success Rate (SR)76.92 | 9 | |
| Object Localization | REVERIE (test unseen) | RGS16.83 | 8 | |
| Object Localization | REVERIE (val unseen) | RGS18.23 | 8 | |
| Object Localization | REVERIE (val seen) | RGS32.75 | 8 | |
| Remote Embodied Visual Referencing | REVERIE 1.0 (test unseen) | Succ.81.51 | 6 | |
| Vision-and-Language Navigation | REVERIE-CE (val seen) | NE5.38 | 5 |
Showing 23 of 23 rows