RLBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Robotic Manipulation | RLBench | Avg Success Score86.8 | 56 | |
| Robotic Manipulation | RLBench (test) | Average Success Rate84.9 | 34 | |
| Multi-task Robotic Manipulation | RLBench | Avg Success Rate83.6 | 16 | |
| close box | RLBench | Success Rate92 | 14 | |
| Robotic Manipulation | RLBench 10 tasks | Pick & Lift Success Rate97.8 | 13 | |
| Embodied Manipulation | RLBench Few-shot Adaptation Tasks (test) | Meat on Grill Success Rate84 | 12 | |
| Robotic Manipulation | RLBench standard (test) | Reach Target Success Rate100 | 12 | |
| Multi-task robotic manipulation | RLBench 100 demonstrations (test) | Average Success Rate93 | 11 | |
| Robot Manipulation | RLBench Moderate Shift | Average Success Rate41.2 | 11 | |
| Robot Manipulation | RLBench Large Shift | Rel. Drop (Avg)-16.1 | 10 | |
| open box | RLBench | Success Rate72 | 10 | |
| stack blocks | RLBench | Success Rate36 | 10 | |
| drag stick | RLBench | Success Rate72 | 10 | |
| close jar | RLBench | Success Rate60 | 10 | |
| put in drawer | RLBench | Success Rate68 | 10 | |
| turn tap | RLBench | Success Rate80 | 10 | |
| meat off grill | RLBench | Success Rate84 | 10 | |
| sweep to dustpan | RLBench | Success Rate72 | 10 | |
| slide block | RLBench | Success Rate72 | 10 | |
| open drawer | RLBench | Success Rate80 | 10 | |
| Robotic Manipulation | RLBench 18 tasks | Average Success Rate89.4 | 9 | |
| Robotic Manipulation | RLBench 18Task | Average Success Rate83.1 | 9 | |
| Failure Detection and Reasoning | RLBench | Detection Accuracy91.7 | 8 | |
| Robot Manipulation | RLBench Large Shift (test) | Average SR39.6 | 8 | |
| push buttons | RLBench | Success Rate88 | 8 |
Showing 25 of 73 rows