Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Catalyst4D: High-Fidelity 3D-to-4D Scene Editing via Dynamic Propagation

About

Recent advances in 3D scene editing using NeRF and 3DGS enable high-quality static scene editing. In contrast, dynamic scene editing remains challenging, as methods that directly extend 2D diffusion models to 4D often produce motion artifacts, temporal flickering, and inconsistent style propagation. We introduce Catalyst4D, a framework that transfers high-quality 3D edits to dynamic 4D Gaussian scenes while maintaining spatial and temporal coherence. At its core, Anchor-based Motion Guidance (AMG) builds a set of structurally stable and spatially representative anchors from both original and edited Gaussians. These anchors serve as robust region-level references, and their correspondences are established via optimal transport to enable consistent deformation propagation without cross-region interference or motion drift. Complementarily, Color Uncertainty-guided Appearance Refinement (CUAR) preserves temporal appearance consistency by estimating per-Gaussian color uncertainty and selectively refining regions prone to occlusion-induced artifacts. Extensive experiments demonstrate that Catalyst4D achieves temporally stable, high-fidelity dynamic scene editing and outperforms existing methods in both visual quality and motion coherence.

Shifeng Chen, Yihui Li, Jun Liao, Hongyu Yang, Di Huang• 2026

Related benchmarks

TaskDatasetResultRank
Dynamic scene editingSteak scene
CLIP Score0.252
6
3D-to-4D Scene Editing16 prompts multi-camera novel viewpoints (test)
EditScore7.375
4
4D Scene EditingDyNeRF Coffee-martini
CLIP Similarity0.249
4
4D Scene EditingMeetRoom Trimming
CLIP Similarity0.251
4
Showing 4 of 4 rows

Other info

Follow for update