Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PD$^{2}$GS: Part-Level Decoupling and Continuous Deformation of Articulated Objects via Gaussian Splatting

About

Articulated objects are ubiquitous and important in robotics, AR/VR, and digital twins. Most self-supervised methods for articulated object modeling reconstruct discrete interaction states and relate them via cross-state geometric consistency, yielding representational fragmentation and drift that hinder smooth control of articulated configurations. We introduce PD$^{2}$GS, a novel framework that learns a shared canonical Gaussian field and models the arbitrary interaction state as its continuous deformation, jointly encoding geometry and kinematics. By associating each interaction state with a latent code and refining part boundaries using generic vision priors, PD$^{2}$GS enables accurate and reliable part-level decoupling while enforcing mutual exclusivity between parts and preserving scene-level coherence. This unified formulation supports part-aware reconstruction, fine-grained continuous control, and accurate kinematic modeling, all without manual supervision. To assess realism and generalization, we release RS-Art, a real-to-sim RGB-D dataset aligned with reverse-engineered 3D models, supporting real-world evaluation. Extensive experiments demonstrate that PD$^{2}$GS surpasses prior methods in geometric and kinematic accuracy, and in consistency under continuous control, both on synthetic and real data.

Haowen Wang, Xiaoping Yuan, Zhao Jin, Zhen Zhao, Zhengping Che, Yousong Xue, Jin Tian, Yakun Huang, Jian Tang• 2025

Related benchmarks

TaskDatasetResultRank
Articulation Axis EstimationPartNet-Mobility v1 (test)
Box Error0.00e+0
20
Joint-level Kinematic EstimationPartNet-Mobility 3-part objects (test)
Axis Angle Error 00.00e+0
20
Articulated Shape ReconstructionPartNet-Mobility v1 (test)
Box Error1.84
20
Articulated Object ModelingPartNet-Mobility 3 movable parts
CD-s2.17
20
Articulated Object ReconstructionPartNet-Mobility 5 movable parts
Axis Angle0.02
12
Part Motion EstimationPartNet-Mobility v1 (test)
Box Motion Error0.87
10
Unseen-state renderingPartNet-Mobility Storage unseen interaction states
PSNR28.02
6
Articulated Object ModelingPartNet-Mobility Storage category
Axis Angle0.13
3
Articulated Object ModelingRS-Art Drawers
Axis Angle Error 00.84
2
Articulated Object ModelingRS-Art Desk Lamps
Axis Angle Error (Joint 0)0.32
2
Showing 10 of 15 rows

Other info

Follow for update