Share your thoughts, 1 month free Claude Pro on usSee more

Vision-Language Navigation on R2R (test unseen)

86SR

Human

Updated 7d ago

Evaluation Results

Method
Human 2020.02	86	1.61	-	76	11.85
Human 2021.07	86	1.61	-	76	11.85
Human 2021.10	86	1.61	-	76	11.85
Human 2021.06	86	1.61	-	76	11.85
Human 2022.10	86	1.61	-	76	11.9
3D Gaussian Map 2026.05	75	3.17	-	65	14.58
BSG 2026.05	73	3.19	-	62	14.86
BEVBert 2026.05	73	3.13	-	62	-
VLN-SIG 2023.12	72	-	-	60	-
AuxRN 2019.11	71	-	-	21	41
Meta-Explore 2023.12	71	3.57	-	61	14.25
AZHP 2023.12	71	3.52	-	60	14.95
DUET+SDB 2026.04	70	3.58	-	61	14.4
Environmental Dropout 2019.11	69	-	-	1	687
DUET 2023.12	69	3.65	-	59	14.73
DUET 2026.04	69	3.65	-	59	14.73
DUET 2026.04	69	3.65	-	59	14.73
DUET 2026.05	69	3.65	-	59	14.73
EnvEdit (on HAMT) 2022.03	68.2	3.59	-	63.9	11.9
AuxRN 2019.11	68	3.69	75	65	-
EnvEdit 2022.10	68	3.59	-	64	11.9
NaviLLM 2023.12	68	3.71	-	60	13.21
S-EGIU 2026.04	68	3.43	-	60	13.96
TD-STP 2026.05	67	3.73	-	61	-
VLN↻Bert+REM 2021.06	65.2	3.87	-	59.1	13.11
REM 2022.03	65.2	3.87	-	59.1	13.11
HAMT 2022.03	65	3.93	-	60	12.27
HAMT 2022.10	65	3.93	-	60	12.27
REM 2022.10	65	3.87	-	59	13.11
HAMT 2021.10	65	3.93	-	60	12.27
HAMT 2023.12	65	3.93	-	60	12.27
HAMT 2026.04	65	3.93	-	60	12.27
HAMT 2026.05	65	3.93	-	60	12.27
LANA 2026.05	65	-	-	60	12.6
Environmental Dropout 2019.11	64	3.97	70	61	-
HOP 2023.12	64	3.83	-	59	12.68
HOP 2026.05	64	3.83	-	59	12.68
Reinforced Cross-Modal 2019.11	63	-	-	2	358
VLNBert (init. PREVALENT) 2021.07	63	4.09	-	57	12.35
VLN↻BERT (init. PREVALENT) 2021.10	63	4.09	-	57	12.35
VLN↻Bert 2021.06	63	4.09	-	57	12.35
GBERT 2022.03	63	4.09	-	57	12.35
RecBERT 2022.10	63	4.09	-	57	12.35
RecBERT 2021.10	63	4.09	-	57	12.35
VLN-BERT 2023.12	63	4.09	-	57	12.35
VLN-PETL 2023.12	63	4.1	-	58	12.3
Rec 2021.08	63	4.09	-	57	12.35
RecBERT 2026.04	63	4.09	-	57	12.35
RecBERT 2026.04	63	4.09	-	57	12.35
HAMT 2026.04	63	4.11	-	58	12.65
RecBERT 2026.05	63	4.09	-	57	12.35
AirBERT 2022.03	62	4.13	-	57	12.41
AirBERT 2022.10	62	4.13	-	57	12.41
MARVAL 2022.10	62	4.18	-	58	10.22
Rec 2021.08	62	4.13	-	57	12.41
VLN↻Bert 2021.06	61.4	4.35	-	56.7	11.68
Reinforced Cross-Modal 2019.11	61	4.21	67	59	-
Self-Monitoring 2019.11	61	-	-	2	373
FAST 2019.11	61	-	-	3	196.53
SSM 2026.05	61	4.57	-	46	20.4
EnvEdit (on EnvDrop-CLIP) 2022.03	60.6	4.3	-	54.4	16.84
Active 2026.05	60	4.33	-	41	21.6
PREVALENT 2020.02	59	4.52	-	56	10.21
EnvDrop-CLIP 2022.03	59	-	-	53	-
EnvDrop+ 2022.10	59	-	-	53	-
NvEM 2021.07	58	4.37	-	54	12.98
VLN↻BERT (init. OSCAR) (reproduced) 2021.10	58	4.55	-	52	12.78
SOAT 2021.10	58	4.49	-	53	12.26
SOAT 2026.05	58	4.49	-	53	12.26
PRESS 2020.02	57	4.53	-	53	10.52
VLNBert (init. OSCAR) 2021.07	57	4.59	-	53	12.34
VLN↻BERT (init. OSCAR) 2021.10	57	4.59	-	53	12.34
Rec 2021.08	57	4.59	-	53	12.34
The Regretful Agent 2019.11	56	5.69	48	40	-
AuxRN 2019.11	55	5.15	62	51	-
AuxRN 2021.07	55	5.15	-	51	-
RelGraph 2021.07	55	4.75	-	52	10.29
AuxRN 2021.06	55	5.15	-	51	-
RelGraph 2021.06	55	4.75	-	52	10.29
AuxRN 2021.10	55	5.15	-	51	-
RelGraph 2021.10	55	4.75	-	52	10.29
AuxRN 2026.05	55	5.15	-	51	-
EnvDrop+REM 2021.06	54.1	5.4	-	50.4	10.73
FAST 2019.11	54	5.14	-	41	-
Speaker-Follower 2019.11	54	-	-	1	1,257
FAST 2020.02	54	5.14	-	41	22.08
PREVALENT 2020.02	54	5.3	-	51	10.51
PREVALENT 2021.07	54	5.3	-	51	10.51
PREVALENT 2021.10	54	5.3	-	51	10.51
FAST-Short 2021.06	54	5.14	-	41	22.08
PREVALENT 2021.06	54	5.3	-	51	10.51
PREVALENT 2022.10	54	5.3	-	51	10.51
PREVALENT 2021.10	54	5.3	-	51	10.51
PREVALENT 2023.12	54	5.3	-	51	10.51
PREVALENT 2021.08	54	5.3	-	51	10.51
Environmental Dropout 2019.11	51	5.23	59	47	-
ENVDROP 2020.02	51	5.23	-	47	11.66
VLNBert (no init.) 2021.07	51	5.45	-	47	11.15
EnvDrop 2021.07	51	5.23	-	47	11.66
EnvDrop 2021.10	51	5.23	-	47	11.66

Showing 100 of 149 rows