Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

M3DDM+: An improved video outpainting by a modified masking strategy

About

M3DDM provides a computationally efficient framework for video outpainting via latent diffusion modeling. However, it exhibits significant quality degradation -- manifested as spatial blur and temporal inconsistency -- under challenging scenarios characterized by limited camera motion or large outpainting regions, where inter-frame information is limited. We identify the cause as a training-inference mismatch in the masking strategy: M3DDM's training applies random mask directions and widths across frames, whereas inference requires consistent directional outpainting throughout the video. To address this, we propose M3DDM+, which applies uniform mask direction and width across all frames during training, followed by fine-tuning of the pretrained M3DDM model. Experiments demonstrate that M3DDM+ substantially improves visual fidelity and temporal coherence in information-limited scenarios while maintaining computational efficiency. The code is available at https://github.com/tamaki-lab/M3DDM-Plus.

Takuya Murakawa, Takumi Fukuzawa, Ning Ding, Toru Tamaki• 2026

Related benchmarks

TaskDatasetResultRank
Video OutpaintingDAVIS
PSNR23.63
8
Video OutpaintingDAVIS Static
MSE0.0551
4
Showing 2 of 2 rows

Other info

Follow for update