SimplerEnv
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Robot Manipulation | SimplerEnv WidowX | Overall Success Rate83.3 | 123 | |
| Robot Manipulation | SimplerEnv Google Robot tasks Variant Aggregation | Average Success Rate75.9 | 109 | |
| Robot Manipulation | SimplerEnv Google Robot Visual Matching | Pick Coke Can98.7 | 79 | |
| Robot Manipulation | SimplerEnv WidowX Robot tasks (test) | Success Rate (Spoon)89.6 | 79 | |
| Robot Manipulation | SimplerEnv Google Robot tasks Visual Matching | Pick Coke Can Success Rate98.1 | 70 | |
| Robotic Manipulation | SimplerEnv | Success Rate: Spoon on Towel87.5 | 60 | |
| Robot Manipulation | SimplerEnv WidowX Visual Matching | Average Success Rate80.8 | 52 | |
| Robot Manipulation | SimplerEnv WidowX (test) | Task Success Rate (Spoon on Towel)79.2 | 41 | |
| Robot Manipulation | SimplerEnv | Pick-Can Success Rate98.7 | 32 | |
| Robot Manipulation | SimplerEnv WidowX Robot tasks | Average Success Rate9,800 | 32 | |
| Robot Manipulation | SimplerEnv Bridge | Carrot Success Count87.5 | 31 | |
| Robotic Manipulation | SimplerEnv Google Robot - Visual Aggregation | Pick Coke Can91.6 | 28 | |
| Move Near | SimplerEnv Google Robot embodiment | Success Rate82 | 28 | |
| Pick Can | SimplerEnv Google Robot embodiment | Success Rate93.3 | 28 | |
| Drawer Opening | SimplerEnv Google Robot embodiment (test) | Success Rate64 | 28 | |
| Robotic Manipulation | SimplerEnv Google Robot Tasks Visual Matching and Variant Aggregation | VM - Pick Coke Can Success Rate85.7 | 27 | |
| Robotic Manipulation | SimplerEnv WidowX v1 (test) | Spoon Success Rate87.5 | 24 | |
| Robot Manipulation | SimplerEnv WidowX | Success Rate: Put Spoon62.5 | 23 | |
| General Robot Manipulation | SimplerEnv | Average Success Rate64.6 | 23 | |
| Robotic Manipulation | SimplerEnv Google Robot tasks (test) | Visual Matching (Pick Coke)85.4 | 22 | |
| Robot Manipulation | SimplerEnv OOD | Average Success Rate64.5 | 21 | |
| Robotic Manipulation | SimplerEnv WidowX (test) | Put Spoon Success Rate87.5 | 20 | |
| Robotic Manipulation | SimplerEnv WidowX Robot Tasks | Grasp Success Rate (Spoon/Towel)95.8 | 19 | |
| Put Eggplant in Basket | SimplerEnv WidowX | Success Rate97.5 | 18 | |
| Stack Green on Yellow | SimplerEnv WidowX | Success Rate98 | 18 |
Showing 25 of 102 rows