Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory

About

Recent advances in video generative models have promoted rapid progress in controllable world models. However, maintaining fine-grained spatio-temporal consistency under long-horizon reasoning remains a key challenge. In this work, we move beyond explicit 3D memory and coarse frame-level implicit modeling, and propose a fine-grained, learnable, and scalable memory for consistent world generation. We first identify two fundamental limitations of na\"ive learnable memory architectures in long-horizon extrapolation, namely computational inefficiency and attention dispersion. Through a systematic analysis of attention dispersion, we propose DecMem, a decoupled memory architecture that employs Sparse Global Memory for efficient fine-grained access to global history and Anchored Local Memory for stable and high-quality extrapolation. Extensive experiments demonstrate that DecMem significantly outperforms current state-of-the-art methods. By ensuring precise and efficient long-term memory and achieving superior extrapolation capabilities, DecMem enables minute-level controllable long video generation with high fidelity and consistency.

Zhenhao Yang, Xiaoshi Wu, Zhengyao Lv, Xiaoyu Shi, Xintao Wang, Pengfei Wan, Kun Gai, Kwan-Yee K. Wong• 2026

Related benchmarks

TaskDatasetResultRank
Controllable Video GenerationMinecraft Within Training Window (test)
PSNR30.0785
4
Controllable Video GenerationMinecraft Extrapolation Generalization (test)
PSNR25.2294
4
Controllable Video GenerationMinecraft User Study (test)
VQ39.77
4
Interactive Video GenerationUser Study
Visual Quality36.22
3
Showing 4 of 4 rows

Other info

GitHub

Follow for update