Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splatting

About

High-fidelity interactive digital assets are essential for embodied intelligence and robotic interaction, yet articulated objects remain challenging to reconstruct due to their complex structures and coupled geometry-motion relationships. Existing methods suffer from instability in geometry-motion joint optimization, while their generalization remains limited on complex multi-joint or out-of-distribution objects. To address these challenges, we propose GEAR, an EM-style alternating optimization framework that jointly models geometry and motion as interdependent components within a Gaussian Splatting representation. GEAR treats part segmentation as a latent variable and joint motion parameters as explicit variables, alternately refining them for improved convergence and geometric-motion consistency. To enhance part segmentation quality without sacrificing generalization, we leverage a vanilla 2D segmentation model to provide multi-view part priors, and employ a weakly supervised constraint to regularize the latent variable. Experiments on multiple benchmarks and our newly constructed dataset GEAR-Multi demonstrate that GEAR achieves state-of-the-art results in geometric reconstruction and motion parameters estimation, particularly on complex articulated objects with multiple movable parts.

Jialin Li, Bin Fu, Ruiping Wang, Xilin Chen• 2026

Related benchmarks

TaskDatasetResultRank
Articulated Object ReconstructionArtGS-Multi
Axis Angle Error0.02
57
Articulated Object Reconstruction and Motion EstimationPARIS Real
Axis Angle Error3.5
27
Articulated ModelingPARIS (Mean)
Axis Angle Error0.02
8
Articulated Object ModelingGEAR-Multi Box
Axis Angle Error0.02
2
Articulated Object ModelingGEAR-Multi Bucket
Axis Angle Error0.00e+0
2
Articulated Object ModelingGEAR-Multi Clock
Axis Angle Error0.05
2
Articulated Object ModelingGEAR-Multi Door
Axis Angle Error0.01
2
Articulated Object ModelingGEAR-Multi Faucet
Axis Angle Error0.32
2
Articulated Object ModelingGEAR-Multi Knife
Axis Angle Error0.3
2
Articulated Object ModelingGEAR-Multi Storage
Axis Angle Error0.03
2
Showing 10 of 14 rows

Other info

Follow for update