Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DSPv2: Improved Dense Policy for Effective and Generalizable Whole-body Mobile Manipulation

About

Learning whole-body mobile manipulation via imitation is essential for generalizing robotic skills to diverse environments and complex tasks. However, this goal is hindered by significant challenges, particularly in effectively processing complex observation, achieving robust generalization, and generating coherent actions. To address these issues, we propose DSPv2, a novel policy architecture. DSPv2 introduces an effective encoding scheme that aligns 3D spatial features with multi-view 2D semantic features. This fusion enables the policy to achieve broad generalization while retaining the fine-grained perception necessary for precise control. Furthermore, we extend the Dense Policy paradigm to the whole-body mobile manipulation domain, demonstrating its effectiveness in generating coherent and precise actions for the whole-body robotic platform. Extensive experiments show that our method significantly outperforms existing approaches in both task performance and generalization ability. Project page is available at: https://selen-suyue.github.io/DSPv2Net/.

Yue Su, Chubin Zhang, Sijin Chen, Liufan Tan, Yansong Tang, Jianan Wang, Xihui Liu• 2025

Related benchmarks

TaskDatasetResultRank
Mobile ManipulationSetTable
Open Fridge Success Rate73.4
12
Inference EfficiencyInference Efficiency Benchmark
TTFT (ms)70
8
Mobile ManipulationManiSkill-HAB TidyHouse
Pick All Success Rate1.3
5
Mobile ManipulationManiSkill-HAB PrepareGroceries
Pick All Success Rate0.9
5
Showing 4 of 4 rows

Other info

Follow for update