Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ReFlow: Self-correction Motion Learning for Dynamic Scene Reconstruction

About

We present ReFlow, a unified framework for monocular dynamic scene reconstruction that learns 3D motion in a novel self-correction manner from raw video. Existing methods often suffer from incomplete scene initialization for dynamic regions, leading to unstable reconstruction and motion estimation, which often resorts to external dense motion guidance such as pre-computed optical flow to further stabilize and constrain the reconstruction of dynamic components. However, this introduces additional complexity and potential error propagation. To address these issues, ReFlow integrates a Complete Canonical Space Construction module for enhanced initialization of both static and dynamic regions, and a Separation-Based Dynamic Scene Modeling module that decouples static and dynamic components for targeted motion supervision. The core of ReFlow is a novel self-correction flow matching mechanism, consisting of Full Flow Matching to align 3D scene flow with time-varying 2D observations, and Camera Flow Matching to enforce multi-view consistency for static objects. Together, these modules enable robust and accurate dynamic scene reconstruction. Extensive experiments across diverse scenarios demonstrate that ReFlow achieves superior reconstruction quality and robustness, establishing a novel self-correction paradigm for monocular 4D reconstruction.

Yanzhe Liang, Ruijie Zhu, Hanzhi Chang, Zhuoyuan Li, Jiahao Lu, Tianzhu Zhang• 2026

Related benchmarks

TaskDatasetResultRank
Dynamic 3D ReconstructionHyperNeRF (test)
PSNR26.15
18
Monocular dynamic scene reconstructionNVIDIA Monocular (Balloon1)
PSNR27.65
8
Monocular dynamic scene reconstructionNVIDIA Monocular (Balloon2)
PSNR29.01
8
Monocular dynamic scene reconstructionNVIDIA Monocular (Jumping)
PSNR24.85
8
Monocular dynamic scene reconstructionNVIDIA Monocular (Playground)
PSNR25.58
8
Monocular dynamic scene reconstructionNVIDIA Monocular (Skating)
PSNR30.17
8
Monocular dynamic scene reconstructionNVIDIA Monocular (Truck)
PSNR30.18
8
Monocular dynamic scene reconstructionNVIDIA Monocular (Umbrella)
PSNR27.21
8
Monocular dynamic scene reconstructionNvidia monocular
PSNR28.2
8
Dynamic Scene ReconstructionNerfies-HyperNeRF (full)
PSNR25.97
7
Showing 10 of 10 rows

Other info

Follow for update