Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splatting

About

Dynamic scene reconstruction is a long-term challenge in the field of 3D vision. Recently, the emergence of 3D Gaussian Splatting has provided new insights into this problem. Although subsequent efforts rapidly extend static 3D Gaussian to dynamic scenes, they often lack explicit constraints on object motion, leading to optimization difficulties and performance degradation. To address the above issues, we propose a novel deformable 3D Gaussian splatting framework called MotionGS, which explores explicit motion priors to guide the deformation of 3D Gaussians. Specifically, we first introduce an optical flow decoupling module that decouples optical flow into camera flow and motion flow, corresponding to camera movement and object motion respectively. Then the motion flow can effectively constrain the deformation of 3D Gaussians, thus simulating the motion of dynamic objects. Additionally, a camera pose refinement module is proposed to alternately optimize 3D Gaussians and camera poses, mitigating the impact of inaccurate camera poses. Extensive experiments in the monocular dynamic scenes validate that MotionGS surpasses state-of-the-art methods and exhibits significant superiority in both qualitative and quantitative results. Project page: https://ruijiezhu94.github.io/MotionGS_page

Ruijie Zhu, Yanzhe Liang, Hanzhi Chang, Jiacheng Deng, Jiahao Lu, Wenfei Yang, Tianzhu Zhang, Yongdong Zhang• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisNeRF-DS
Average PSNR26.56
26
Novel View SynthesisNeRF-DS Bell
PSNR26.63
15
Novel View SynthesisNeRF-DS Sieve
PSNR26.17
15
Novel View SynthesisNeRF-DS Cup
PSNR24.97
15
Novel View SynthesisNeRF-DS Plate
PSNR21.01
15
Novel View SynthesisNeRF-DS Press
PSNR25.63
15
Novel View SynthesisNeRF-DS Basin
PSNR20.11
15
Dynamic View SynthesisNeRF-DS (test)
PSNR23.71
10
4D ReconstructionHyperNeRF (vrig)
PSNR20.96
5
Novel View SynthesisHyperNeRF vrig (Broom)
PSNR22.3
4
Showing 10 of 14 rows

Other info

Code

Follow for update