SOTA Vision-and-Language Navigation benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
R2R (val unseen)	DUET + ScaleVLN + Vision-Sharing	Success Rate (SR)82.46	344	19d ago
REVERIE (val unseen)	GOAT-ATENA	SPL53.2	173	1mo ago
R2R (val seen)	GOAT	Success Rate (SR)83.74	68	19d ago
R2R-CE (test-unseen)	CLASH	SR66	63	1mo ago
REVERIE unseen (test)		Success Rate (SR)81.5	59	1mo ago
R4R unseen (val)	VLN↻Bert+REM	Success Rate (SR)46	52	1mo ago
Room-to-Room (R2R) Unseen (val)	PANOGEN	SR74.2	52	1mo ago
R2R-CE (val-seen)	CLASH	SR73	49	1mo ago
R2R (test)		SPL (Success weighted Path Length)76	49	1mo ago
R2R-CE unseen continuous (val)	SpatialAnt	SR66	35	18d ago
RxR (Room-Across-Room) unseen (val)	P3Nav	SR (Success Rate)69.2	32	1mo ago
Room-to-Room (R2R) Seen (val)	VLNBert (init. PREVALENT)	NE (Navigation Error)2.9	32	1mo ago
REVERIE (test)	DUET	SPL3,606	30	1mo ago
REVERIE seen (val)	GOAT	SR78.64	28	1mo ago
Room-to-Room (R2R) (val unseen)	HAMT	NE2.29	27	1mo ago
GSA-R2R N-Scene (test)	NavGPT-2	SR56.67	26	19d ago
SOON (val unseen)	SID	SPL38.4	25	1mo ago
Room-to-Room (R2R) (test unseen)	VLN-BERT	SR63	24	1mo ago
OpenUAV Seen Hard (test)		Navigation Error (m)17.16	23	25d ago
OpenUAV Easy (test seen)		Navigation Error (m)11.68	23	25d ago
R8R unseen (val)	SEQ2SEQ	PL56.4	22	1mo ago
R6R unseen (val)	RCM(GOAL)	PL11.8	22	1mo ago
IR2R (val-unseen)	HAMT	TL9.4	21	19d ago
IR2R (val-seen)	TourHAMT	Trajectory Length (TL)9.4	21	19d ago
RxR seen (val)	MARVAL	SR75.9	21	1mo ago

Showing 25 of 111 rows