PD$^{2}$GS: Part-Level Decoupling and Continuous Deformation of Articulated Objects via Gaussian Splatting
About
Articulated objects are ubiquitous and important in robotics, AR/VR, and digital twins. Most self-supervised methods for articulated object modeling reconstruct discrete interaction states and relate them via cross-state geometric consistency, yielding representational fragmentation and drift that hinder smooth control of articulated configurations. We introduce PD$^{2}$GS, a novel framework that learns a shared canonical Gaussian field and models the arbitrary interaction state as its continuous deformation, jointly encoding geometry and kinematics. By associating each interaction state with a latent code and refining part boundaries using generic vision priors, PD$^{2}$GS enables accurate and reliable part-level decoupling while enforcing mutual exclusivity between parts and preserving scene-level coherence. This unified formulation supports part-aware reconstruction, fine-grained continuous control, and accurate kinematic modeling, all without manual supervision. To assess realism and generalization, we release RS-Art, a real-to-sim RGB-D dataset aligned with reverse-engineered 3D models, supporting real-world evaluation. Extensive experiments demonstrate that PD$^{2}$GS surpasses prior methods in geometric and kinematic accuracy, and in consistency under continuous control, both on synthetic and real data.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Articulation Axis Estimation | PartNet-Mobility v1 (test) | Box Error0.00e+0 | 20 | |
| Joint-level Kinematic Estimation | PartNet-Mobility 3-part objects (test) | Axis Angle Error 00.00e+0 | 20 | |
| Articulated Shape Reconstruction | PartNet-Mobility v1 (test) | Box Error1.84 | 20 | |
| Articulated Object Modeling | PartNet-Mobility 3 movable parts | CD-s2.17 | 20 | |
| Articulated Object Reconstruction | PartNet-Mobility 5 movable parts | Axis Angle0.02 | 12 | |
| Part Motion Estimation | PartNet-Mobility v1 (test) | Box Motion Error0.87 | 10 | |
| Unseen-state rendering | PartNet-Mobility Storage unseen interaction states | PSNR28.02 | 6 | |
| Articulated Object Modeling | PartNet-Mobility Storage category | Axis Angle0.13 | 3 | |
| Articulated Object Modeling | RS-Art Drawers | Axis Angle Error 00.84 | 2 | |
| Articulated Object Modeling | RS-Art Desk Lamps | Axis Angle Error (Joint 0)0.32 | 2 |