SIMPLER
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Robotic Manipulation | SIMPLER Visual Matching WidowX robot | Put Spoon on Towel Score95.8 | 51 | |
| Robotic Manipulation | SIMPLER Google Robot VA | Pick Up Coke Can Success Rate98 | 35 | |
| Robotic Manipulation | SIMPLER Visual Matching | Average Success Rate78.1 | 26 | |
| Robotic Manipulation | SIMPLER Google Robot Visual Matching | PickCan Success Rate97.2 | 24 | |
| Move Near | SIMPLER Google Robot Setup | Success Rate95.8 | 12 | |
| Pick Coke | SIMPLER Google Robot Setup | Success Rate95.7 | 12 | |
| Robotic Manipulation | SIMPLER | Success Rate (StackG2Y)54.2 | 11 | |
| Robot Manipulation | SIMPLER WidowX + Bridge Setup | Spoon Success Rate62.5 | 10 | |
| Robot manipulation | SIMPLER Google robot, Visual Matching setting (test) | Success Rate (PCC)96 | 10 | |
| Spoon2Cloth | SIMPLER Bridge | Success Rate70.8 | 9 | |
| Carrot2Plate | SIMPLER Bridge tasks | Success Rate62.5 | 9 | |
| Robotic Manipulation | SIMPLER Overall | Success Rate (All)63 | 7 | |
| Robot Manipulation | SIMPLER Out-of-Distribution Env | Success Count: Redbull on Plate51 | 6 | |
| Robot Manipulation | SIMPLER In-Distribution Env | Carrot on Plate Success Rate52 | 6 | |
| Cross-embodiment Skill Generalization | SIMPLER Google robot Cross-embodiment evaluation | Spoon Put on Towel Success Rate56.3 | 5 | |
| Robotic Manipulation | SIMPLER novel YCB and GSO objects 1.0 (test) | Success Count: Green Cube96 | 5 | |
| Robotic Product Cloning | SIMPLER Benchmark novel deployment tasks | Monster Energy Drink V1 Success Rate70 | 4 | |
| Robotic Manipulation | SIMPLER (test) | Success Rate26.3 | 3 |
Showing 18 of 18 rows