Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DexDiffuser: Generating Dexterous Grasps with Diffusion Models

About

We introduce DexDiffuser, a novel dexterous grasping method that generates, evaluates, and refines grasps on partial object point clouds. DexDiffuser includes the conditional diffusion-based grasp sampler DexSampler and the dexterous grasp evaluator DexEvaluator. DexSampler generates high-quality grasps conditioned on object point clouds by iterative denoising of randomly sampled grasps. We also introduce two grasp refinement strategies: Evaluator-Guided Diffusion (EGD) and Evaluator-based Sampling Refinement (ESR). The experiment results demonstrate that DexDiffuser consistently outperforms the state-of-the-art multi-finger grasp generation method FFHNet with an, on average, 9.12% and 19.44% higher grasp success rate in simulation and real robot experiments, respectively. Supplementary materials are available at https://yulihn.github.io/DexDiffuser_page/

Zehang Weng, Haofei Lu, Danica Kragic, Jens Lundell• 2024

Related benchmarks

TaskDatasetResultRank
Dexterous Functional GraspingDexGraspNet Mechanic Tool
Success Rate60.4
4
Dexterous Functional GraspingDexGraspNet Kitchenware
Success Rate49.3
4
Showing 2 of 2 rows

Other info

Follow for update