GCNGrasp-VP: Affordance-Guided View Planning for Efficient Task-Oriented Grasping
About
Task-oriented grasping performance degrades significantly when object views suffer from occlusions. Existing task-oriented grasping methods typically assume task-relevant regions are visible in the initial frame, while view planning approaches enable active perception but often ignore task semantics and rely on time-consuming scene reconstruction. To address these limitations, we present GCNGrasp-VP, an efficient framework integrating affordance field prediction with active view planning. Central to this framework is GCNGrasp-v2, a task-oriented grasp model that simultaneously supports grasp evaluation and affordance field prediction, achieving constant-time inference complexity. Leveraging this capability, our Affordance-guided View Planner (Affordance-VP) utilizes the affordance field as an information gain metric to guide camera observation of task-relevant regions without requiring scene reconstruction. View planning results show that our method significantly outperforms scene-uncertainty-driven baselines with only one view adjustment. Real-world validation further confirms substantial improvements in grasp success rates for single-object scenarios while maintaining millisecond-level computational latency. Code and models are available at https://github.com/Instinct323/GCNGrasp-VP.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Task-Oriented Grasping | TaskGrasp Object Instance Generalization complete shape | mAPins80.72 | 4 | |
| Task-Oriented Grasping | TaskGrasp Task Generalization complete shape | mAPins82.72 | 4 | |
| Task-Oriented Grasping | Real-world Evaluation | Pan Pour Success Count24 | 4 | |
| Task-Oriented Grasping | TaskGrasp Object Instance Generalization partial view | mAPins80.51 | 3 | |
| Task-Oriented Grasping | TaskGrasp Task Generalization partial view | mAPins81.52 | 3 |