Robotic Planning

Benchmarks

Dataset Name	SOTA Method	Metric
OGBench Scene 48 (play)	CoFi	Success Rate0.63	16	1mo ago
OGBench AntMaze Giant 48 (stitch)	CoFi	Success Rate85	16	1mo ago
OGBench PointMaze Giant 48 (stitch)	CoFi	Success Rate96	16	1mo ago
LEMMA Single-Agent Overall	SG-CoT	Success Rate (SR)80	14	4mo ago
LEMMA Single-Agent Underspecified	SG-CoT	Success Rate (SR)99	14	4mo ago
LEMMA Single-Agent Absence	SG-CoT	Success Rate (SR)96	14	4mo ago
LEMMA Single-Agent Multiplicity	SG-CoT	Success Rate (SR)77	14	4mo ago
OGBench Antmaze Stitch (Large)	CDGS	Success Rate88	8	1mo ago
OGBench Antmaze Stitch Medium	CD	Success Rate97	8	1mo ago
OGBench Pointmaze Stitch Large	GSC	Success Rate100	8	1mo ago
Robotic Planning Overall (combined)	SCT-4B	Success Rate46	8	2mo ago
Robotic Planning (Unseen Tasks)	SCT-4B	Prepare Experiment Success Rate45	8	2mo ago
Robotic Planning (Seen Tasks)	SCT-4B	Classic Success Rate60	8	2mo ago
LEMMA Stack and Pass tasks, partially observed (test)	SG-CoT	Success Rate75	8	4mo ago
EB-ALFRED (test)	RoboAgent	Base Score72	7	2mo ago
Robotouille Impossible		Solved Percentage100	7	4mo ago
Robotouille Hard		Solved Rate58.1	7	4mo ago
Robotouille Easy		Solved Rate81	7	4mo ago
Maze2D hybrid composition (100 samples)	MPPI + g^car	Safety Score95	6	2mo ago
Maze2D dynamic obstacles (100 samples)	MPPI + g^car	Safety Score96	6	2mo ago
Maze2D static goal (100 samples)	MPPI + g^car	Safety100	6	2mo ago
Maze2D static obstacles (100 samples)		Safety100	6	2mo ago
EB-Habitat (test)	RoboEvolve	Average Success Rate54.3	6	2mo ago
Set Table	MoMaStage	Success Rate93.67	6	4mo ago
Prepare_Groceries	MoMaStage	Success Rate91.67	6	4mo ago

Showing 25 of 37 rows