GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splatting
About
High-fidelity interactive digital assets are essential for embodied intelligence and robotic interaction, yet articulated objects remain challenging to reconstruct due to their complex structures and coupled geometry-motion relationships. Existing methods suffer from instability in geometry-motion joint optimization, while their generalization remains limited on complex multi-joint or out-of-distribution objects. To address these challenges, we propose GEAR, an EM-style alternating optimization framework that jointly models geometry and motion as interdependent components within a Gaussian Splatting representation. GEAR treats part segmentation as a latent variable and joint motion parameters as explicit variables, alternately refining them for improved convergence and geometric-motion consistency. To enhance part segmentation quality without sacrificing generalization, we leverage a vanilla 2D segmentation model to provide multi-view part priors, and employ a weakly supervised constraint to regularize the latent variable. Experiments on multiple benchmarks and our newly constructed dataset GEAR-Multi demonstrate that GEAR achieves state-of-the-art results in geometric reconstruction and motion parameters estimation, particularly on complex articulated objects with multiple movable parts.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Articulated Object Reconstruction | ArtGS-Multi | Axis Angle Error0.02 | 57 | |
| Articulated Object Reconstruction and Motion Estimation | PARIS Real | Axis Angle Error3.5 | 27 | |
| Articulated Modeling | PARIS (Mean) | Axis Angle Error0.02 | 8 | |
| Articulated Object Modeling | GEAR-Multi Box | Axis Angle Error0.02 | 2 | |
| Articulated Object Modeling | GEAR-Multi Bucket | Axis Angle Error0.00e+0 | 2 | |
| Articulated Object Modeling | GEAR-Multi Clock | Axis Angle Error0.05 | 2 | |
| Articulated Object Modeling | GEAR-Multi Door | Axis Angle Error0.01 | 2 | |
| Articulated Object Modeling | GEAR-Multi Faucet | Axis Angle Error0.32 | 2 | |
| Articulated Object Modeling | GEAR-Multi Knife | Axis Angle Error0.3 | 2 | |
| Articulated Object Modeling | GEAR-Multi Storage | Axis Angle Error0.03 | 2 |