Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

RoboCasa

Benchmarks

Task NameDataset NameSOTA ResultTrend
Robotic ManipulationRoboCasa
Average Success Rate80.6
68
Robotic Tabletop ManipulationRoboCasa GR1 Tabletop Tasks
Average Success Rate58.3
28
Robotic ManipulationRoboCasa GR1 Tabletop
Average Success Rate72.8
24
Robotic ManipulationRoboCasa Kitchen
Success Rate70.6
22
Robot ManipulationRoboCasa GR1
Average Success Rate63.2
20
CoffeeServeMugRoboCasa
Success Rate49.1
20
Robotic ManipulationRoboCasa365
Average Success Rate42
18
Robotic ManipulationRoboCasa Panda GR00T (test)
Success Rate67.2
16
Robot ManipulationRoboCasa-GR1 24 tasks
Average Success Rate79.2
16
Tabletop Robot ManipulationRobocasa Tabletop GR1
Container Interaction Success Rate55.6
15
Closed-loop PlanningRoboCasa Rc-Pl
Success Rate34.4
14
Closed-loop PlanningRoboCasa Rc-R
Success Rate49
14
CoffeeSetupMugRoboCasa
Success Rate20
13
Robot ManipulationRoboCasa CloseDrawer
Success Rate82.3
12
Robotic ManipulationRoboCasa GR1 Tabletop Manipulation (test)
PnP Bottle To Cabinet Close76
12
Kitchen manipulationRoboCasa 24 kitchen manipulation tasks
Average Success Rate67.1
12
Robot ManipulationRoboCasa365 pretraining (test)
Average Success Rate46.6
11
Robotic ManipulationRoboCasa (val)
Average Success Rate64
10
Long-horizon household tasksRoboCasa 24-task benchmark Human-50 few-shot
Pick & Place Success Rate40
9
Counter-to-Cabinet manipulationRoboCasa365 Counter-to-Cabinet (ID Failure Episodes)
Success Rate22.8
8
Early Failure DetectionRoboCasa L (Seen)
ROC-AUC (q=0.25)82.7
8
Early Failure DetectionRoboCasa S (Unseen)
ROC-AUC (q=0.25)73.8
8
Early Failure DetectionRoboCasa S (Seen)
ROC-AUC (q=0.25)74.9
8
Early Failure DetectionRoboCasa (Unseen)
ROC-AUC (q=0.25)76.3
8
Early Failure DetectionRoboCasa (Seen)
ROC-AUC (q=0.25)77.4
8
Showing 25 of 107 rows