Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objects

About

Reconstructing articulated objects is essential for building digital twins of interactive environments. However, prior methods typically decouple geometry and motion by first reconstructing object shape in distinct states and then estimating articulation through post-hoc alignment. This separation complicates the reconstruction pipeline and restricts scalability, especially for objects with complex, multi-part articulation. We introduce a unified representation that jointly models geometry and motion using articulated 3D Gaussians. This formulation improves robustness in motion decomposition and supports articulated objects with up to 20 parts, significantly outperforming prior approaches that often struggle beyond 2--3 parts due to brittle initialization. To systematically assess scalability and generalization, we propose MPArt-90, a new benchmark consisting of 90 articulated objects across 20 categories, each with diverse part counts and motion configurations. Extensive experiments show that our method consistently achieves superior accuracy in part-level geometry reconstruction and motion estimation across a broad range of object types. We further demonstrate applicability to downstream tasks such as robotic simulation and human-scene interaction modeling, highlighting the potential of unified articulated representations in scalable physical modeling.

Licheng Shen, Saining Zhang, Honghan Li, Peilin Yang, Zihao Huang, Zongzheng Zhang, Hao Zhao• 2025

Related benchmarks

TaskDatasetResultRank
Articulated Object ReconstructionGS-PM Simulation
Axis Angle Error0.02
9
Articulated Object ReconstructionGS-PM (Real)
Axis Angle Error2.23
7
Novel View RenderingPARIS Two-Part Simulation (test)
PSNR (FoldChair)48.37
4
Articulated Object Geometry and Motion EstimationDigitalTwinArt-PM Fridge 10489 (test)
Axis Angle Error 00.02
4
Articulated Object Geometry and Motion EstimationDigitalTwinArt-PM Storage 47254 (test)
Axis Angle Error 00.02
4
Novel View RenderingPARIS Two-Part (test)
PSNR (Fridge)26.43
4
Articulated Object ReconstructionArticulate-100 (2 Parts)
Axis Angle Error53.25
3
Articulated Object ReconstructionArticulate-100 (3 Parts)
Axis Angle Error32.49
3
Articulated Object ReconstructionArticulate-100 (4-5 Parts)
Axis Angle Error19.73
3
Articulated Object ReconstructionArticulate-100 (6+ Parts)
Axis Angle Error24.87
3
Showing 10 of 16 rows

Other info

Follow for update