Our new X account is live! Follow @wizwand_team for updates

Vision-and-Language Navigation on RxR (Room-Across-Room) unseen (val)

68.2SR (Success Rate)

GOAT

Updated 4d ago

Evaluation Results

Method	Links
GOAT 2024.04		68.2	61.7	0.671	0.566
EnvEdit (on HAMT) 2022.03		62.8	-	0.685	54.6
VLN-SIG 2023.04		60	-	0.653	0.514
VLN-PETL 2023.08		57.95	54.16	0.6494	0.497
VLN-PETL 2024.04		57.9	54.2	0.649	0.497
Fine-Tuning 2023.08		57.88	54.18	0.6452	0.4944
HAMT 2022.03		56.5	-	0.631	48.3
HAMT 2023.04		56.5	-	0.631	0.483
Adapter 2023.08		55.19	51.44	0.6356	0.4732
LoRA 2023.08		54.53	51.14	0.6323	0.4694
MARM-MP 2024.04		50.2	-	0.603	0.439
EnvEdit (on EnvDrop-CLIP) 2022.03		50.1	-	0.606	43
ADAPT 2024.04		46.9	40.2	0.541	0.377
HOP+ 2024.04		45.7	38.4	0.52	0.36
SOAT 2024.04		44.2	-	0.548	0.364
FOAM 2024.04		42.8	38.7	0.541	0.356
EnvDrop-CLIP 2022.03		42.6	-	0.557	-
HOP 2022.03		42.3	0.36	0.52	0.33
HOP 2022.03		42.1	0.36	0.51	0.33
EnvDrop + Syntax 2022.03		39.2	0.35	0.52	0.32
Syntax 2024.04		39.2	35	0.52	0.32
EnvDrop 2022.03		38.5	0.34	0.51	0.32
BitFit 2023.08		36.63	34.34	0.5047	0.3049
HOP 2022.03		36.3	0.31	0.48	0.29
Prompt Tuning 2023.08		29.95	27.72	0.4494	0.2467
Baseline 2022.03		26.1	-	0.42	0.21