Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioning

About

Existing 4D-driven video diffusion models primarily target plausible generation, but faithful 4D editing requires preserving source-observed regions while synthesizing disoccluded or out-of-view content. We identify Evidence-Role Mismatch: reliable source-backed evidence, unreliable rendered cues, and unsupported regions are entangled in a single conditioning signal, causing preservation drift, ghosting, and unstable extrapolation. We propose PREX (Preserve, Reveal, Expand), a region-aware framework that decomposes the target spatiotemporal volume into Preserve, Reveal, and Expand roles according to observation support and scene extent. PREX builds observation-backed appearance cues with calibrated confidence and injects them into a frozen video diffusion backbone through a region-aware adapter, trained with proxy tasks without requiring paired edited videos. We further introduce PREBench, a diagnostic benchmark with curated edits, region-role masks, and human-aligned metrics that complement global video-quality and 4D-control evaluations. Experiments show that PREX reduces region-structured failures while maintaining strong visual quality and 4D edit control capability. Project Page: https://ricepastem.github.io/PREX-Open

Zhangchi Hu, Wenzhang Sun, Xiangchen Yin, Jiahui Yuan, Chunfeng Wang, Hao Li, Kun Zhan, Xiaoyan Sun• 2026

Related benchmarks

TaskDatasetResultRank
Video ReconstructionDAVIS
PSNR22.6
29
4D Camera ControlPREBench Camera-only
Camera Rotation Error1.2345
7
Global Video QualityVBench (test)
Overall Score77.99
6
Video Content PreservationPREBench (test)
P-LPIPS0.2137
6
Video Scene ExpansionPREBench (test)
Temporal Consistency (E-Temp)0.0615
6
Video Reveal CompletionPREBench (test)
R-Ghost0.1374
6
4D Camera and Object Motion ControlPREBench Joint camera/object
Camera Rotation Error1.5676
4
Video Motion Editing20 real-world motion editing cases
Motion Alignment90.1
3
Showing 8 of 8 rows

Other info

Follow for update