Our new X account is live! Follow @wizwand_team for updates

Vision-Language Navigation on R2R (test unseen)

86SR

Human

Updated 4d ago

Evaluation Results

Method
Human 2020.02	86	1.61	-	76	11.85
Human 2021.07	86	1.61	-	76	11.85
Human 2021.10	86	1.61	-	76	11.85
Human 2021.06	86	1.61	-	76	11.85
Human 2022.10	86	1.61	-	76	11.9
VLN-SIG 2023.12	72	-	-	60	-
AuxRN 2019.11	71	-	-	21	41
Meta-Explore 2023.12	71	3.57	-	61	14.25
AZHP 2023.12	71	3.52	-	60	14.95
Environmental Dropout 2019.11	69	-	-	1	687
DUET 2023.12	69	3.65	-	59	14.73
EnvEdit (on HAMT) 2022.03	68.2	3.59	-	63.9	11.9
AuxRN 2019.11	68	3.69	75	65	-
EnvEdit 2022.10	68	3.59	-	64	11.9
NaviLLM 2023.12	68	3.71	-	60	13.21
VLN↻Bert+REM 2021.06	65.2	3.87	-	59.1	13.11
REM 2022.03	65.2	3.87	-	59.1	13.11
HAMT 2022.03	65	3.93	-	60	12.27
HAMT 2022.10	65	3.93	-	60	12.27
REM 2022.10	65	3.87	-	59	13.11
HAMT 2021.10	65	3.93	-	60	12.27
HAMT 2023.12	65	3.93	-	60	12.27
Environmental Dropout 2019.11	64	3.97	70	61	-
HOP 2023.12	64	3.83	-	59	12.68
Reinforced Cross-Modal 2019.11	63	-	-	2	358
VLNBert (init. PREVALENT) 2021.07	63	4.09	-	57	12.35
VLN↻BERT (init. PREVALENT) 2021.10	63	4.09	-	57	12.35
VLN↻Bert 2021.06	63	4.09	-	57	12.35
GBERT 2022.03	63	4.09	-	57	12.35
RecBERT 2022.10	63	4.09	-	57	12.35
RecBERT 2021.10	63	4.09	-	57	12.35
VLN-BERT 2023.12	63	4.09	-	57	12.35
VLN-PETL 2023.12	63	4.1	-	58	12.3
Rec 2021.08	63	4.09	-	57	12.35
AirBERT 2022.03	62	4.13	-	57	12.41
AirBERT 2022.10	62	4.13	-	57	12.41
MARVAL 2022.10	62	4.18	-	58	10.22
Rec 2021.08	62	4.13	-	57	12.41
VLN↻Bert 2021.06	61.4	4.35	-	56.7	11.68
Reinforced Cross-Modal 2019.11	61	4.21	67	59	-
Self-Monitoring 2019.11	61	-	-	2	373
FAST 2019.11	61	-	-	3	196.53
EnvEdit (on EnvDrop-CLIP) 2022.03	60.6	4.3	-	54.4	16.84
PREVALENT 2020.02	59	4.52	-	56	10.21
EnvDrop-CLIP 2022.03	59	-	-	53	-
EnvDrop+ 2022.10	59	-	-	53	-
NvEM 2021.07	58	4.37	-	54	12.98
VLN↻BERT (init. OSCAR) (reproduced) 2021.10	58	4.55	-	52	12.78
SOAT 2021.10	58	4.49	-	53	12.26
PRESS 2020.02	57	4.53	-	53	10.52
VLNBert (init. OSCAR) 2021.07	57	4.59	-	53	12.34
VLN↻BERT (init. OSCAR) 2021.10	57	4.59	-	53	12.34
Rec 2021.08	57	4.59	-	53	12.34
The Regretful Agent 2019.11	56	5.69	48	40	-
AuxRN 2019.11	55	5.15	62	51	-
AuxRN 2021.07	55	5.15	-	51	-
RelGraph 2021.07	55	4.75	-	52	10.29
AuxRN 2021.06	55	5.15	-	51	-
RelGraph 2021.06	55	4.75	-	52	10.29
AuxRN 2021.10	55	5.15	-	51	-
RelGraph 2021.10	55	4.75	-	52	10.29
EnvDrop+REM 2021.06	54.1	5.4	-	50.4	10.73
FAST 2019.11	54	5.14	-	41	-
Speaker-Follower 2019.11	54	-	-	1	1,257
FAST 2020.02	54	5.14	-	41	22.08
PREVALENT 2020.02	54	5.3	-	51	10.51
PREVALENT 2021.07	54	5.3	-	51	10.51
PREVALENT 2021.10	54	5.3	-	51	10.51
FAST-Short 2021.06	54	5.14	-	41	22.08
PREVALENT 2021.06	54	5.3	-	51	10.51
PREVALENT 2022.10	54	5.3	-	51	10.51
PREVALENT 2021.10	54	5.3	-	51	10.51
PREVALENT 2023.12	54	5.3	-	51	10.51
PREVALENT 2021.08	54	5.3	-	51	10.51
Environmental Dropout 2019.11	51	5.23	59	47	-
ENVDROP 2020.02	51	5.23	-	47	11.66
VLNBert (no init.) 2021.07	51	5.45	-	47	11.15
EnvDrop 2021.07	51	5.23	-	47	11.66
EnvDrop 2021.10	51	5.23	-	47	11.66
EnvDrop 2021.06	51	5.23	-	47	11.66
EnvDrop 2021.10	51	5.23	-	47	11.66
EnvDrop 2021.08	51	5.23	-	47	11.66
Rec 2021.08	51	5.45	-	47	11.15
EnvDrop 2021.06	50.5	5.84	-	46.5	11.32
PRESS 2020.02	49	5.49	-	45	10.77
PRESS 2021.07	49	5.49	-	45	10.77
PRESS 2021.06	49	5.49	-	45	10.77
PRESS 2021.10	49	5.49	-	45	10.77
PRESS 2021.08	49	5.49	-	45	10.77
IL+RL+REM 2021.06	48.7	5.67	-	45.1	9.81
Self-Monitoring 2019.11	48	5.67	59	35	-
ALTR 2019.11	48	5.49	-	45	-
The Regretful Agent 2019.11	48	-	-	40	13.69
SMNA 2020.02	48	5.67	-	35	18.04
REGRETFUL 2020.02	48	5.69	-	40	13.69
SM 2021.07	48	5.67	-	35	18.04
Regretful 2021.07	48	5.69	-	40	13.69
SMNA 2021.06	48	5.67	-	35	18.04
IL+RL 2021.06	46.4	5.88	-	43.3	9.58
Reinforced Cross-Modal 2019.11	43	6.12	50	38	-

Showing 100 of 122 rows