SIMPLER
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Robotic Manipulation | SIMPLER Visual Matching WidowX robot | Put Spoon on Towel Score95.8 | 24 | |
| Robotic Manipulation | SIMPLER Google Robot Visual Matching | PickCan Success Rate97.2 | 24 | |
| Robotic Manipulation | SIMPLER Google Robot VA | Pick Up Coke Can Success Rate95.7 | 20 | |
| Robotic Manipulation | SIMPLER Visual Matching | Pick Coke Success95 | 12 | |
| Robotic Manipulation | SIMPLER Overall | Success Rate (All)63 | 7 | |
| Robotic Manipulation | SIMPLER | Success Rate (StackG2Y)54.2 | 7 | |
| Robot Manipulation | SIMPLER Out-of-Distribution Env | Success Count: Redbull on Plate51 | 6 | |
| Robot Manipulation | SIMPLER In-Distribution Env | Carrot on Plate Success Rate52 | 6 | |
| Cross-embodiment Skill Generalization | SIMPLER Google robot Cross-embodiment evaluation | Spoon Put on Towel Success Rate56.3 | 5 | |
| Robotic Manipulation | SIMPLER novel YCB and GSO objects 1.0 (test) | Success Count: Green Cube96 | 5 | |
| Robotic Manipulation | SIMPLER (test) | Success Rate26.3 | 3 |
Showing 11 of 11 rows