Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Part$^{2}$GS: Part-aware Modeling of Articulated Objects using 3D Gaussian Splatting

About

Articulated objects are common in the real world, yet modeling their structure and motion remains a challenging task for 3D reconstruction methods. In this work, we introduce Part$^{2}$GS, a novel framework for modeling articulated digital twins of multi-part objects with high-fidelity geometry and physically consistent articulation. Part$^{2}$GS leverages a part-aware 3D Gaussian representation that encodes articulated components with learnable attributes, enabling structured, disentangled transformations that preserve high-fidelity geometry. To ensure physically consistent motion, we propose a motion-aware canonical representation guided by physics-based constraints, including contact enforcement, velocity consistency, and vector-field alignment. Furthermore, we introduce a field of repel points to prevent part collisions and maintain stable articulation paths, significantly improving motion coherence over baselines. Extensive evaluations on both synthetic and real-world datasets show that Part$^{2}$GS consistently outperforms state-of-the-art methods by up to 10$\times$ in Chamfer Distance for movable parts.

Tianjiao Yu, Vedant Shah, Muntasir Wahed, Ying Shen, Kiet A. Nguyen, Ismini Lourentzou• 2025

Related benchmarks

TaskDatasetResultRank
Articulated Object Reconstruction and Motion EstimationPARIS Simulation
Axis Angle Error0.01
56
Articulated Object Reconstruction and Motion EstimationPARIS Real
Axis Angle Error0.03
27
Articulated Object ReconstructionDTA-MULTI ARTGS-MULTI Table 4 parts
Angular Error0.08
3
Articulated Object ReconstructionDTA-MULTI ARTGS-MULTI Table 5 parts
Angle Error0.03
3
Articulated Object ReconstructionDTA-MULTI ARTGS-MULTI Storage 3 parts
Angular Error0.01
3
Articulated Object ReconstructionDTA-MULTI ARTGS-MULTI Storage 4 parts
Angular Error0.01
3
Articulated Object ReconstructionDTA-MULTI ARTGS-MULTI Storage 7 parts
Angular Error0.11
3
Articulated Object ReconstructionDTA-MULTI ARTGS-MULTI Oven 4 parts
Angular Error0.03
3
Articulated Object ReconstructionDTA-MULTI ARTGS-MULTI Fridge 3 parts
Angle Error0.01
3
InferenceComplex Objects
Fridge39
3
Showing 10 of 12 rows

Other info

Follow for update