SOTA Language-conditioned robot manipulation benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
LIBERO-Long Severity 5	OpenPi–0.5	Success Rate47.7	5	15d ago
LIBERO-Long Severity 4	OpenPi–0.5	Success Rate65.6	5	15d ago
LIBERO-Long Severity 3	OpenVLA-OFT	Success Rate77.6	5	15d ago
LIBERO Long Clean	OpenVLA-OFT	Success Rate94.4	5	15d ago
LIBERO-Goal Severity 5	StableVLA	Success Rate71.9	5	15d ago
LIBERO-Goal Severity 4	StableVLA	Success Rate85	5	15d ago
LIBERO-Goal Severity 3	OpenVLA-OFT	Success Rate94.5	5	15d ago
LIBERO-Goal Clean	StableVLA	Success Rate98	5	15d ago
LIBERO-Object Severity 5	OpenPi–0.5	Success Rate76.4	5	15d ago
LIBERO-Object Severity 4	OpenPi–0.5	Success Rate88.4	5	15d ago
LIBERO-Object Severity 3	OpenPi–0.5	Success Rate97.1	5	15d ago
LIBERO-Object Clean	OpenPi–0.5	Success Rate99.4	5	15d ago
LIBERO-Spatial Severity 5	StableVLA	Success Rate82	5	15d ago
LIBERO-Spatial Severity 4	StableVLA	Success Rate92.1	5	15d ago
LIBERO-Spatial Severity 3	StableVLA	Success Rate94.4	5	15d ago
LIBERO-Spatial Clean	OpenPi–0.5	Success Rate98.4	5	15d ago
Real-world expansion (test)	π0.5-KG	Task 1 Success Rate96	4	15d ago
LOReL Sawyer 15 unseen instructions (test)	LISA	Success Rate20.89	3	3mo ago
CALVIN Severity 5	StableVLA	Success Rate1.51	2	15d ago
CALVIN Severity 4	StableVLA	Success Rate2.11	2	15d ago
CALVIN Severity 3	StableVLA	Success Rate2.77	2	15d ago
CALVIN Clean	StableVLA	Success Rate4.17	2	15d ago

Showing 22 of 22 rows