CityNav
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Navigation | CityNav seen (val) | Navigation Error (NE)9.1 | 14 | |
| Navigation | CityNav unseen (val) | Navigation Error (NE)9.4 | 14 | |
| Navigation | CityNav (test unseen) | Navigation Error (NE)9.8 | 14 | |
| Vision-and-Language Navigation | CityNav Unseen (test) | NE45.73 | 13 | |
| Navigation | CityNav Sao Paulo 1.0 | Success29 | 12 | |
| Navigation | CityNav Vienna 1.0 | Success56 | 12 | |
| Navigation | CityNav Tokyo 1.0 | Success Rate0.3 | 12 | |
| Navigation | CityNav New York 1.0 | Success Rate95 | 12 | |
| Aerial Vision-and-Language Navigation | CityNav Unseen (test) | NE9.8 | 11 | |
| Aerial Vision-and-Language Navigation | CityNav Unseen (val) | Navigation Error9.4 | 11 | |
| Aerial Vision-and-Language Navigation | CityNav seen (val) | Navigation Error (NE)9.1 | 11 | |
| Aerial Vision-and-Language Navigation | CityNav Unseen Original Refined (test) | NE9.8 | 8 | |
| Aerial Vision-and-Language Navigation | CityNav Original Refined (val Unseen) | Navigation Error (NE)9.4 | 8 | |
| Aerial Vision-and-Language Navigation | CityNav Seen Original Refined (val) | Navigation Error (NE)9.1 | 8 | |
| Visual Language Navigation | CityNav (val Unseen) | Navigation Error (NE)63.11 | 7 | |
| Visual Language Navigation | CityNav (val Seen) | Navigation Error (NE)59.41 | 7 | |
| Vision-Language Navigation | CityNav Hard | Navigation Error (NE)58.96 | 6 | |
| Vision-Language Navigation | CityNav Medium | Navigation Error (Path Length)51.51 | 6 | |
| Vision-Language Navigation | CityNav Easy | Navigation Error (NE)47.75 | 6 | |
| Trajectory Prediction | CityNav | ADE (m)0.86 | 5 | |
| Vision-Language Navigation | CityNav Seen Hard difficulty (val) | NE68.9 | 5 | |
| Vision-Language Navigation | CityNav Seen Medium difficulty (val) | Navigation Error (NE)53.8 | 5 | |
| Vision-Language Navigation | CityNav Easy difficulty (val Seen) | Navigation Error (NE)53.89 | 5 |
Showing 23 of 23 rows