CityNav
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Navigation | CityNav seen (val) | Navigation Error (NE)9.1 | 14 | |
| Navigation | CityNav unseen (val) | Navigation Error (NE)9.4 | 14 | |
| Navigation | CityNav (test unseen) | Navigation Error (NE)9.8 | 14 | |
| Navigation | CityNav Sao Paulo 1.0 | Success29 | 12 | |
| Navigation | CityNav Vienna 1.0 | Success56 | 12 | |
| Navigation | CityNav Tokyo 1.0 | Success Rate0.3 | 12 | |
| Navigation | CityNav New York 1.0 | Success Rate95 | 12 | |
| Aerial Vision-and-Language Navigation | CityNav Unseen (test) | NE9.8 | 11 | |
| Aerial Vision-and-Language Navigation | CityNav Unseen (val) | Navigation Error9.4 | 11 | |
| Aerial Vision-and-Language Navigation | CityNav seen (val) | Navigation Error (NE)9.1 | 11 | |
| Aerial Vision-and-Language Navigation | CityNav Unseen Original Refined (test) | NE9.8 | 8 | |
| Aerial Vision-and-Language Navigation | CityNav Original Refined (val Unseen) | Navigation Error (NE)9.4 | 8 | |
| Aerial Vision-and-Language Navigation | CityNav Seen Original Refined (val) | Navigation Error (NE)9.1 | 8 | |
| Vision-Language Navigation | CityNav Hard | Navigation Error (NE)58.96 | 6 | |
| Vision-Language Navigation | CityNav Medium | Navigation Error (Path Length)51.51 | 6 | |
| Vision-Language Navigation | CityNav Easy | Navigation Error (NE)47.75 | 6 | |
| Vision-and-Language Navigation | CityNav Unseen (test) | NE45.73 | 6 |
Showing 17 of 17 rows