SOTA Vision-and-Language Navigation benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
R2R (val unseen)	ScaleVLN	Success Rate (SR)81	260	4d ago
REVERIE (val unseen)	GOAT-ATENA	SPL53.2	129	4d ago
R4R unseen (val)	VLN↻Bert+REM	Success Rate (SR)46	52	4d ago
Room-to-Room (R2R) Unseen (val)	PANOGEN	SR74.2	52	4d ago
R2R (val seen)	GOAT	Success Rate (SR)83.74	51	4d ago
R2R-CE (test-unseen)	CLASH	SR66	50	4d ago
R2R-CE (val-seen)	CLASH	SR73	49	4d ago
REVERIE unseen (test)	GOAT	Success Rate (SR)57.72	40	4d ago
R2R (test)		SPL (Success weighted Path Length)76	38	4d ago
Room-to-Room (R2R) Seen (val)	VLNBert (init. PREVALENT)	NE (Navigation Error)2.9	32	4d ago
REVERIE seen (val)	GOAT	SR78.64	28	4d ago
RxR (Room-Across-Room) unseen (val)	GOAT	SR (Success Rate)68.2	26	4d ago
Room-to-Room (R2R) (test unseen)	VLN-BERT	SR63	24	4d ago
R8R unseen (val)	SEQ2SEQ	PL56.4	22	4d ago
R6R unseen (val)	RCM(GOAL)	PL11.8	22	4d ago
RxR seen (val)	MARVAL	SR75.9	21	4d ago
VLN-CE 1.0 (val-unseen)	HPN-C	Navigation Error (NE)6.02	20	4d ago
VLN-CE 1.0 (val-seen)	CM²-GT	Navigation Error (NE)4.81	20	4d ago
R2R-CE v1.0 (val unseen)	CLASH	NE (Navigation Error)4.06	19	4d ago
REVERIE (test)	DUET	SPL3,606	17	4d ago
VLN-CE (test-unseen)	ETPNav	Navigation Error (NE)5.15	17	4d ago
Large Real-Floor-Plan Environments	Ours	SPL0.87	16	4d ago
Small Synthetic Environments	Ours	SPL0.92	16	4d ago
SOON (val unseen)	SUSA	SPL30.8	16	4d ago
Room-across-Room (RxR) unseen (test)	Human	SR93.9	16	4d ago

Showing 25 of 90 rows