SOTA Vision-and-Language Navigation benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
R2R (val unseen)	SRDF	Success Rate (SR)84	476	18d ago
REVERIE (val unseen)	GOAT-ATENA	SPL53.2	237	23d ago
REVERIE unseen (test)		Success Rate (SR)81.5	110	1mo ago
R2R-CE (val-seen)	CLASH	SR73	103	22d ago
R2R (val seen)	GOAT	Success Rate (SR)83.74	68	3mo ago
REVERIE seen (val)	DUET + ATENA	SR84.33	64	2mo ago
R2R-CE (test-unseen)	CLASH	SR66	63	4mo ago
R2R-CE v1.0 (val unseen)	CorrectNav	SR (Success Rate)65.1	61	1mo ago
R4R unseen (val)	Ours	Success Rate (SR)47	60	1mo ago
Room-to-Room (R2R) Unseen (val)	PANOGEN	SR74.2	52	5mo ago
R2R (test)	SkillNav	SPL (Success weighted Path Length)77	51	2mo ago
OpenUAV Seen Hard (test)		Navigation Error (m)17.16	37	24d ago
OpenUAV Easy (test seen)		Navigation Error (m)11.68	37	24d ago
GSA-R2R N-Scene (test)	NavGPT-2 (FlanT5-5B)	SR57	37	2mo ago
SOON (val unseen)	SID	SPL38.4	37	1mo ago
R2R-CE unseen continuous (val)	SpatialAnt	SR66	35	3mo ago
RxR (Room-Across-Room) unseen (val)	P3Nav	SR (Success Rate)69.2	32	4mo ago
Room-to-Room (R2R) Seen (val)	VLNBert (init. PREVALENT)	NE (Navigation Error)2.9	32	5mo ago
REVERIE (test)	DUET	SPL3,606	30	4mo ago
Room-to-Room (R2R) (val unseen)	HAMT	NE2.29	27	4mo ago
Room-to-Room (R2R) (test unseen)	VLN-BERT	SR63	24	5mo ago
OpenUAV Full (test seen)		Navigation Error (NE)14.15	23	24d ago
R8R unseen (val)	SEQ2SEQ	PL56.4	22	5mo ago
R6R unseen (val)	RCM(GOAL)	PL11.8	22	5mo ago
GSA-R2R N-Basic (test)	SkillNav (ScaleVLN-Aug)	SR72	21	2mo ago

Showing 25 of 141 rows