Share your thoughts, 1 month free Claude Pro on usSee more

Vision-Language Navigation on R2R (val seen)

7,540Success Rate (SR)

VLNBERT+REM

Updated 9d ago

Evaluation Results

Method
VLNBERT+REM 2022.04	7,540	10.88	2.48	71.8
IDEA 2026.05	83	10.89	2.15	0.79
BEVBert + IDEA 2026.05	83	10.89	2.15	0.79
BEVBert + FEEDTTA 2026.05	82	11.88	2.17	0.77
BEVBert + ATENA 2026.05	82	10.79	2.26	0.78
Meta-Explore 2023.03	81	11.95	2.11	75
IDEA 2026.05	81	11.23	2.03	0.76
BEVBert 2026.05	81	13.56	2.17	0.74
ViDA 2026.05	81	12.53	2.31	0.74
ReCAP 2026.05	81	12.31	2.27	0.74
BEVBert 2026.05	81	13.56	2.17	0.74
DUET + IDEA 2026.05	81	11.23	2.03	0.76
BEVBert 2026.05	81	13.56	2.17	0.74
BEVBert + ReCAP 2026.05	81	12.31	2.27	0.74
Tent 2026.05	80	12.68	2.36	0.74
SAR 2026.05	80	12.49	2.28	0.74
FSTTA 2026.05	80	12.28	2.31	0.75
DUET + FeedTTA 2026.05	80	11.49	2.09	0.75
DUET + ATENA 2026.05	80	11.27	2.18	0.75
BEVBert + RLCF 2026.05	80	12.94	2.23	0.74
BEVBert + FSTTA 2026.05	80	12.28	2.31	0.75
KERM 2023.03	79.73	12.16	2.19	73.79
DUET 2023.03	79	12.32	2.28	73
DUET 2026.05	79	12.33	2.28	0.73
ViDA 2026.05	79	12.11	2.31	0.73
FSTTA 2026.05	79	13.39	2.25	0.73
DUET 2026.05	79	12.33	2.28	0.73
DUET + RLCF 2026.05	79	12.28	2.25	0.74
DUET 2026.05	79	12.33	2.28	0.73
DUET + FSTTA 2026.05	79	13.39	2.25	0.73
DUET 2023.03	78.84	12.3	2.28	72.89
Tent 2026.05	78	12.17	2.38	0.72
SAR 2026.05	78	12.05	2.28	0.72
ReCAP 2026.05	78	12.02	2.27	0.73
DUET + ReCAP 2026.05	78	12.02	2.27	0.73
EnvEdit (on HAMT) 2022.03	76.9	11.18	2.32	0.739
EnvEdit 2022.10	76.9	11.18	2.32	0.739
HOP (1) 2022.03	76	11.51	2.46	70
HAMT 2022.03	76	11.15	2.51	0.72
HAMT-e2e 2023.03	76	11.15	2.51	72
HAMT 2022.10	76	11.15	2.51	0.72
HAMT 2021.10	76	11.15	2.51	72
VLN↻Bert+REM 2021.06	75.4	10.88	2.48	71.8
REM 2022.03	75.4	10.88	2.48	0.718
REM 2022.10	75.4	10.88	2.48	0.718
AirBERT 2022.03	75	11.09	2.68	70
HOP (2) 2022.03	75	11.26	2.72	70
AirBERT 2022.03	75	11.09	2.68	0.7
AirBERT 2023.03	75	11.09	2.68	70
HOP 2023.03	75	11.26	2.72	70
AirBERT 2022.10	75	11.09	2.68	0.7
Rec 2021.08	75	11.16	2.54	71
Rec 2021.08	75	11.09	2.68	70
MARVAL 2022.10	73	10.6	2.99	0.691
Fine-Tuning 2023.08	72.67	11.48	2.94	0.6917
MARVAL 2022.10	72.3	10.43	3.11	0.689
VLN-PETL 2023.08	72.28	11.39	2.93	0.685
VLN↻Bert 2021.06	72	11.13	2.9	68
RecBERT 2022.03	72	11.13	2.9	68
GBERT 2022.03	72	11.13	2.9	0.68
VLNBERT 2022.04	72	11.13	2.9	0.68
VLNBERT 2023.03	72	11.13	2.9	68
VLNBERT 2023.03	72	11.13	2.9	68
RecBERT 2022.10	72	11.13	2.9	0.68
RecBERT 2021.10	72	11.13	2.9	68
Rec 2021.08	72	11.13	2.9	68
VLNBERT 2022.04	71	10.79	3.11	0.67
SSM 2022.04	71	14.7	3.1	0.62
SSM 2023.03	71	14.7	3.1	62
Rec 2021.08	71	10.79	3.11	67
VLN↻Bert 2021.06	70.7	12.09	2.99	65.9
LORA 2023.08	70.13	11.73	3.14	0.66
EnvDrop+REM 2021.06	70.1	11.13	3.14	66.7
AuxRN 2021.06	70	-	3.33	67
ActiveVLN 2022.03	70	19.7	3.2	52
EnvDrop+REM 2022.04	70	11.13	3.14	0.66
AuxRN 2022.04	70	-	3.33	0.67
FAST 2023.03	70	188.06	3.13	64
AuxRN 2023.03	70	-	3.33	67
AuxRN 2021.10	70	-	3.33	67
EnvEdit (on EnvDrop-CLIP) 2022.03	69.4	14.64	3.35	0.642
PREVALENT 2021.06	69	10.32	3.67	65
Regretful 2022.03	69	-	3.23	63
NvEM 2022.03	69	11.09	3.44	65
PREVALENT 2022.03	69	10.32	3.67	65
PREVALENT 2022.04	69	10.32	3.67	0.65
Regretful 2022.04	69	-	3.23	0.63
NvEM 2022.04	69	11.09	3.44	0.65
SMNA 2023.03	69	11.69	3.31	63
Regretful-Agent 2023.03	69	-	3.23	63
PREVALENT 2023.03	69	10.32	3.67	65
PREVALENT 2022.10	69	10.32	3.67	0.65
PREVALENT 2021.10	69	10.32	3.67	65
PREVALENT 2021.08	69	10.32	3.67	65
MARVAL 2022.10	68.2	10.32	3.73	0.649
Rec 2021.08	68	10.95	3.37	64
Adapter 2023.08	67.38	11.7	3.34	0.6442
SMNA 2021.06	67	-	3.22	58
RCM+SIL 2021.06	67	10.65	3.53	-
RelGraph 2021.06	67	10.13	3.47	65

Showing 100 of 150 rows