Learning Motion Feasibility from Point Clouds in Cluttered Environments
About
Motion feasibility prediction plays a central role in robotics, particularly in task and motion planning and manipulation. A major bottleneck for this problem in cluttered environments is that infeasible planning attempts by Sampling-based motion planners (SBMPs) can incur substantial computational cost. Also existing approaches for infeasibility certification are limited to low-dimensional configuration spaces and often assume simplified geometric environments represented by primitive objects with known parameters. We study the complementary problem of learning motion feasibility prediction directly from raw RGB-D observations for a 7-DOF manipulator operating in realistic cluttered scenes. We introduce the first large-scale benchmark for this setting, comprising 2.7M grasp feasibility labels over 88 scanned objects and 190 cluttered tabletop scenes. We benchmark three representative classifier families spanning MLP- based, volumetric-CNN, and point-cloud-based Transformer architectures under matched training conditions. Our best model, GRASPFC-PTX (a point-cloud transformer), achieves an AUROC of 0.996 on Novel objects while providing predictions significantly faster than SBMPs.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Feasibility classification | GraspNet-1Billion 1.0 (Seen) | AUROC0.996 | 6 | |
| Feasibility classification | GraspNet-1Billion 1.0 (Similar) | AUROC99.6 | 6 | |
| Feasibility classification | GraspNet-1Billion 1.0 (Novel) | AUROC0.996 | 6 | |
| Grasp feasibility prediction | GraspNet-1Billion Novel | Latency (ms)4.4 | 5 | |
| Motion-feasibility | MOFEAS In-distribution (Novel) | Cost Ratio84 | 3 | |
| Motion-feasibility | MOFEAS Cluttered | Cost Ratio112 | 3 | |
| Motion-feasibility | MOFEAS Unseen scene | Cost Ratio133 | 3 | |
| Motion-feasibility prediction | MOFEAS-200K Cluttered | AUROC99.3 | 3 | |
| Motion-feasibility prediction | MOFEAS-200K (Unseen scene) | AUROC0.852 | 3 |