Vision-and-Language Navigation on REVERIE unseen (test)
81.5Success Rate (SR)
Human
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2025.09 | 81.5 | 21.2 | 86.8 | 53.7 | 77.8 | - | |
2025.09 | 60.4 | 20.2 | 65.5 | 45.9 | 36.6 | 27.7 | |
2026.03 | 60.06 | - | - | 40.57 | 39.75 | 26.56 | |
2024.04 | 57.72 | - | - | 40.53 | 38.32 | 26.7 | |
2026.03 | 57.72 | - | - | 40.53 | 38.32 | 26.7 | |
2025.09 | 57.7 | - | - | 40.5 | 38.3 | 26.7 | |
2024.10 | 56.82 | 22.7 | 62.22 | 38.76 | 33.88 | 24.74 | |
2026.03 | 56.82 | - | - | 38.76 | 33.88 | 23.19 | |
2025.09 | 56.8 | 24.7 | 62.2 | 38.8 | 33.9 | 23.2 | |
2025.09 | 56.5 | 22.9 | 62.8 | 38.7 | 33.2 | 22.3 | |
2024.10 | 56.45 | 22.9 | 62.83 | 38.7 | 33.15 | 22.34 | |
2026.03 | 56.45 | - | - | 38.7 | 33.15 | 22.34 | |
2025.09 | 56.1 | - | 62.7 | 39.5 | 32.5 | 22.8 | |
2025.09 | 55.2 | - | 62.3 | 38.9 | 32.2 | 22.7 | |
2024.12 | 55.1 | - | - | 37.1 | - | 22.2 | |
2024.12 | 54.3 | - | - | 41.5 | - | 27.3 | |
2024.04 | 54.04 | - | - | 37.09 | 32.49 | 22.18 | |
2026.03 | 54.04 | - | - | 37.09 | 32.49 | 22.18 | |
2024.10 | 53.19 | 22.7 | 59.38 | 36.26 | 33.1 | 22.14 | |
2024.04 | 53.13 | - | - | 36.6 | 34.87 | 23.45 | |
2026.03 | 53.13 | - | - | 36.6 | 34.87 | 23.45 | |
2024.12 | 53.1 | - | - | 36.6 | - | 23.4 | |
2024.04 | 52.81 | - | - | 36.41 | 32.06 | 22.09 | |
2024.10 | 52.81 | - | 57.26 | 36.41 | 32.06 | 22.09 | |
2026.03 | 52.81 | - | - | 36.41 | 32.06 | 22.09 | |
2025.09 | 52.8 | - | 57.3 | 36.4 | 32.1 | 22.1 | |
2023.03 | 52.51 | 21.3 | 56.91 | 36.06 | - | - | |
2024.04 | 52.51 | - | - | 36.06 | 31.88 | 22.06 | |
2024.10 | 52.51 | 21.3 | 56.91 | 36.06 | 31.88 | 22.06 | |
2026.03 | 52.51 | - | - | 36.06 | 31.88 | 22.06 | |
2024.12 | 52.5 | - | - | 36.1 | - | 22.5 | |
2024.12 | 52.5 | - | - | 36 | - | 22 | |
2025.09 | 52.5 | 21.3 | 56.9 | 36.1 | 31.9 | 22.1 | |
2023.03 | 52.43 | 17.32 | 57.58 | 39.21 | - | - | |
2023.03 | 52.26 | 18.38 | 57.44 | 37.46 | - | - | |
2024.12 | 52.2 | - | - | 37.4 | - | 23.1 | |
2024.12 | 51.9 | - | - | 34.7 | - | 23.6 | |
2024.10 | 51.72 | 18.83 | 57.2 | 36.45 | 32.95 | 22.85 | |
2024.12 | 49.6 | - | - | 36.4 | - | 22 | |
2025.09 | 43.5 | - | 56.2 | 34.5 | - | - | |
2024.10 | 35.89 | - | 40.26 | 27.51 | 19.88 | 15.4 | |
2024.04 | 33.82 | - | - | 28.24 | 20.2 | 16.86 | |
2024.10 | 30.95 | 15.9 | 34 | 24.46 | 17.14 | 14.12 | |
2023.03 | 30.4 | 13.62 | 33.41 | 26.67 | - | - | |
2024.04 | 30.4 | - | - | 26.67 | 14.88 | 13.08 | |
2024.10 | 30.4 | 13.62 | 33.41 | 26.67 | 14.88 | 13.08 | |
2026.03 | 30.4 | - | - | 26.67 | 14.88 | 13.08 | |
2023.03 | 30.28 | 17.91 | 34.2 | 23.61 | - | - | |
2024.10 | 30.28 | 17.91 | 34.2 | 23.61 | 16.83 | 13.28 | |
2023.03 | 30.17 | 16.38 | 33.06 | 24.34 | - | - | |
2024.10 | 30.17 | 16.38 | 33.06 | 24.34 | 17.69 | 14.34 | |
2023.03 | 29.61 | 15.68 | 32.91 | 23.99 | - | - | |
2024.10 | 29.61 | 15.86 | 32.91 | 23.99 | 16.5 | 13.51 | |
2024.10 | 19.88 | 39.05 | 30.63 | 11.61 | 11.28 | 6.08 | |
2023.03 | 7.84 | 10.6 | 11.68 | 6.67 | - | - | |
2024.10 | 7.84 | 10.6 | 11.68 | 6.67 | 3.67 | 3.14 | |
2024.12 | 7.8 | - | - | 6.6 | - | 3.1 | |
2023.03 | 3.99 | 10.89 | 6.88 | 3.09 | - | - | |
2024.10 | 3.99 | 10.89 | 6.88 | 3.09 | 2 | 1.58 |