SimplerEnv
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Robot Manipulation | SimplerEnv WidowX | Success Rate: Put Spoon on Towel95.8 | 98 | |
| Robot Manipulation | SimplerEnv Google Robot tasks Variant Aggregation | Average Success Rate75.9 | 88 | |
| Robot Manipulation | SimplerEnv WidowX Robot tasks (test) | Success Rate (Spoon)89.6 | 79 | |
| Robot Manipulation | SimplerEnv Google Robot Visual Matching | Pick Coke Can98.7 | 65 | |
| Robot Manipulation | SimplerEnv Google Robot tasks Visual Matching | Pick Coke Can Success Rate98.1 | 62 | |
| Robotic Manipulation | SimplerEnv | Success Rate: Spoon on Towel87.5 | 42 | |
| Robot Manipulation | SimplerEnv WidowX Visual Matching | Average Success Rate79.3 | 34 | |
| Robot Manipulation | SimplerEnv WidowX Robot tasks | Average Success Rate9,800 | 32 | |
| Robot Manipulation | SimplerEnv WidowX (test) | Task Success Rate (Spoon on Towel)62.5 | 31 | |
| Robotic Manipulation | SimplerEnv Google Robot - Visual Aggregation | Pick Coke Can91.6 | 28 | |
| Move Near | SimplerEnv Google Robot embodiment | Success Rate82 | 28 | |
| Pick Can | SimplerEnv Google Robot embodiment | Success Rate93.3 | 28 | |
| Drawer Opening | SimplerEnv Google Robot embodiment (test) | Success Rate64 | 28 | |
| Robotic Manipulation | SimplerEnv Google Robot Tasks Visual Matching and Variant Aggregation | VM - Pick Coke Can Success Rate85.7 | 27 | |
| General Robot Manipulation | SimplerEnv | Average Success Rate64.6 | 23 | |
| Robot Manipulation | SimplerEnv Bridge | Carrot Success Count75 | 23 | |
| Robot Manipulation | SimplerEnv OOD | Average Success Rate64.5 | 21 | |
| Put Eggplant in Basket | SimplerEnv WidowX | Success Rate97.5 | 18 | |
| Stack Green on Yellow | SimplerEnv WidowX | Success Rate98 | 18 | |
| Put Carrot on Plate | SimplerEnv WidowX | Success Rate0.987 | 18 | |
| Put Spoon on Towel | SimplerEnv WidowX | Success Rate98 | 18 | |
| Simulation Object Manipulation | SimplerEnv WidowX + Bridge setup | Placement Success Rate (Spoon on Towel)58.3 | 16 | |
| Robotic Manipulation | SimplerEnv WidowX Robot | Success Rate: Put Spoon on Towel62.5 | 15 | |
| Robot Manipulation | SimplerEnv WidowX (held-out) | Put Spoon on Towel Success Rate90.63 | 14 | |
| Robotic Manipulation | SimplerEnv Google Robot tasks (test) | Visual Matching (Pick Coke)85.4 | 14 |
Showing 25 of 89 rows