Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Stitch4D: Sparse Multi-Location 4D Urban Reconstruction via Spatio-Temporal Interpolation

About

Dynamic urban environments are often captured by cameras placed at spatially separated locations with little or no view overlap. However, most existing 4D reconstruction methods assume densely overlapping views and struggle under sparse multi-location observations, producing unstable reconstructions in unobserved intermediate regions. To address this practical yet underexplored setting, we propose Stitch4D, a unified 4D reconstruction framework that compensates for missing spatial coverage in sparsely observed urban environments. Stitch4D synthesizes intermediate bridge views between distant camera locations and jointly optimizes real and synthesized observations in a unified coordinate frame with inter-location consistency constraints. By recovering intermediate spatial coverage before optimization, Stitch4D mitigates geometric collapse and improves reconstruction stability in sparse regions. To evaluate this setting, we introduce Urban Sparse 4D (U-S4D), a controlled CARLA-based benchmark for free-viewpoint reconstruction under sparse multi-location configurations. Experiments on U-S4D show that Stitch4D consistently outperforms representative 4D reconstruction baselines in image-quality metrics. These results suggest that recovering intermediate spatial coverage is an effective strategy for stabilizing 4D reconstruction in sparse urban environments. The project page is provided in https://stitch4d-project-page.vercel.app/.

Hina Kogure, Kei Katsumata, Taiki Miyanishi, Komei Sugiura• 2026

Related benchmarks

TaskDatasetResultRank
Seen-viewpoints synthesisU-S4D (Temporal split)
PSNR (dB)24.12
9
Trajectory InterpolationU-S4D Full reconstruction
PSNR (dB)15.98
9
Trajectory InterpolationU-S4D (Temporal)
PSNR (dB)16.01
9
Seen-viewpoints synthesisU-S4D Full reconstruction
PSNR (dB)25.62
5
Novel View SynthesisU-S4D (full reconstruction, seen-viewpoints)
PSNR (dB)25.62
4
Showing 5 of 5 rows

Other info

Follow for update