Our new X account is live! Follow @wizwand_team for updates

Vision-Language Navigation on R2R (val seen)

7,540Success Rate (SR)

VLNBERT+REM

Updated 4d ago

Evaluation Results

Method
VLNBERT+REM 2022.04	7,540	10.88	2.48	71.8
Meta-Explore 2023.03	81	11.95	2.11	75
KERM 2023.03	79.73	12.16	2.19	73.79
DUET 2023.03	79	12.32	2.28	73
DUET 2023.03	78.84	12.3	2.28	72.89
EnvEdit (on HAMT) 2022.03	76.9	11.18	2.32	0.739
EnvEdit 2022.10	76.9	11.18	2.32	0.739
HOP (1) 2022.03	76	11.51	2.46	70
HAMT 2022.03	76	11.15	2.51	0.72
HAMT-e2e 2023.03	76	11.15	2.51	72
HAMT 2022.10	76	11.15	2.51	0.72
HAMT 2021.10	76	11.15	2.51	72
VLN↻Bert+REM 2021.06	75.4	10.88	2.48	71.8
REM 2022.03	75.4	10.88	2.48	0.718
REM 2022.10	75.4	10.88	2.48	0.718
AirBERT 2022.03	75	11.09	2.68	70
HOP (2) 2022.03	75	11.26	2.72	70
AirBERT 2022.03	75	11.09	2.68	0.7
AirBERT 2023.03	75	11.09	2.68	70
HOP 2023.03	75	11.26	2.72	70
AirBERT 2022.10	75	11.09	2.68	0.7
Rec 2021.08	75	11.16	2.54	71
Rec 2021.08	75	11.09	2.68	70
MARVAL 2022.10	73	10.6	2.99	0.691
Fine-Tuning 2023.08	72.67	11.48	2.94	0.6917
MARVAL 2022.10	72.3	10.43	3.11	0.689
VLN-PETL 2023.08	72.28	11.39	2.93	0.685
VLN↻Bert 2021.06	72	11.13	2.9	68
RecBERT 2022.03	72	11.13	2.9	68
GBERT 2022.03	72	11.13	2.9	0.68
VLNBERT 2022.04	72	11.13	2.9	0.68
VLNBERT 2023.03	72	11.13	2.9	68
VLNBERT 2023.03	72	11.13	2.9	68
RecBERT 2022.10	72	11.13	2.9	0.68
RecBERT 2021.10	72	11.13	2.9	68
Rec 2021.08	72	11.13	2.9	68
VLNBERT 2022.04	71	10.79	3.11	0.67
SSM 2022.04	71	14.7	3.1	0.62
SSM 2023.03	71	14.7	3.1	62
Rec 2021.08	71	10.79	3.11	67
VLN↻Bert 2021.06	70.7	12.09	2.99	65.9
LORA 2023.08	70.13	11.73	3.14	0.66
EnvDrop+REM 2021.06	70.1	11.13	3.14	66.7
AuxRN 2021.06	70	-	3.33	67
ActiveVLN 2022.03	70	19.7	3.2	52
EnvDrop+REM 2022.04	70	11.13	3.14	0.66
AuxRN 2022.04	70	-	3.33	0.67
FAST 2023.03	70	188.06	3.13	64
AuxRN 2023.03	70	-	3.33	67
AuxRN 2021.10	70	-	3.33	67
EnvEdit (on EnvDrop-CLIP) 2022.03	69.4	14.64	3.35	0.642
PREVALENT 2021.06	69	10.32	3.67	65
Regretful 2022.03	69	-	3.23	63
NvEM 2022.03	69	11.09	3.44	65
PREVALENT 2022.03	69	10.32	3.67	65
PREVALENT 2022.04	69	10.32	3.67	0.65
Regretful 2022.04	69	-	3.23	0.63
NvEM 2022.04	69	11.09	3.44	0.65
SMNA 2023.03	69	11.69	3.31	63
Regretful-Agent 2023.03	69	-	3.23	63
PREVALENT 2023.03	69	10.32	3.67	65
PREVALENT 2022.10	69	10.32	3.67	0.65
PREVALENT 2021.10	69	10.32	3.67	65
PREVALENT 2021.08	69	10.32	3.67	65
MARVAL 2022.10	68.2	10.32	3.73	0.649
Rec 2021.08	68	10.95	3.37	64
Adapter 2023.08	67.38	11.7	3.34	0.6442
SMNA 2021.06	67	-	3.22	58
RCM+SIL 2021.06	67	10.65	3.53	-
RelGraph 2021.06	67	10.13	3.47	65
RCM 2022.03	67	10.65	3.53	-
EntityGraph 2022.03	67	10.13	3.47	65
SM 2022.04	67	-	3.22	0.58
RCM+SIL 2022.04	67	10.65	3.53	-
RelGraph 2022.04	67	10.13	3.47	0.65
NvEM+SEvol 2022.04	67	11.97	3.56	0.63
EntityGraph 2023.03	67	10.13	3.47	65
RelGraph 2021.10	67	10.13	3.47	65
Speaker-Follower 2021.06	66	-	3.36	-
SF 2022.03	66	-	3.36	-
HOP (0) 2022.03	66	10.75	3.5	63
Speaker-Follower 2022.04	66	-	3.36	-
Active Perception 2022.04	66	19.8	3.35	0.51
SF 2021.10	66	-	3.36	-
Speaker-Follower 2021.08	66	-	3.36	-
OAAM 2022.03	65	10.2	-	62
Regretful 2022.04	65	-	3.69	0.59
SSM 2022.04	65	13.5	3.77	0.57
EnvDrop 2021.06	64.4	10.46	3.78	62
BitFit 2023.08	63.47	11.61	3.78	0.6035
NvEM+SEvol 2022.04	63	12.07	3.96	0.59
EnvDrop 2021.06	62	11	3.99	59
EnvDrop 2022.03	62	11	3.99	59
VLNBERT 2022.04	62	9.78	3.92	0.59
EnvDrop 2022.04	62	11	3.99	0.59
EnvDrop 2021.10	62	11	3.99	59
EnvDrop 2021.08	62	11	3.99	59
Rec 2021.08	62	9.78	3.92	59
Prompt Tuning 2023.08	61.02	10.67	4.24	0.5859
EnvDrop+SEvol 2022.04	61	12.55	3.7	0.57

Showing 100 of 120 rows