Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

A$^2$RD: Agentic Autoregressive Diffusion for Long Video Consistency

About

Synthesizing consistent and coherent long video remains a fundamental challenge. Existing methods suffer from semantic drift and narrative collapse over long horizons. We present A$^2$RD, an Agentic Auto-Regressive Diffusion architecture that decouples creative synthesis from consistency enforcement. A$^2$RD formulates long video synthesis as a closed-loop process that synthesizes and self-improves video segment-by-segment through a Retrieve--Synthesize--Refine--Update cycle. It comprises three core components: (i) Multimodal Video Memory that tracks video progression across modalities; (ii) Adaptive Segment Generation that switches among generation modes for natural progression and visual consistency; and (iii) Hierarchical Test-Time Self-Improvement that self-improves each segment at frame and video levels to prevent error propagation. We further introduce LVBench-C, a challenging benchmark with non-linear entity and environment transitions to stress-test long-horizon consistency. Across public and LVBench-C benchmarks spanning one- to ten-minute videos, A$^2$RD outperforms state-of-the-art baselines by up to 30% in consistency and 20% in narrative coherence. Human evaluations corroborate these gains while also highlighting notable improvements in motion and transition smoothness.

Do Xuan Long, Yale Song, Min-Yen Kan, Tomas Pfister, Long T. Le• 2026

Related benchmarks

TaskDatasetResultRank
Video GenerationVBench-Long 8 continuous scenes for 1-min videos
Semantic Alignment0.2111
8
Video GenerationVBench
Subject Consistency92.31
8
Video SynthesisLVbench-C 3-min, 24 scenes
Semantic Alignment22.15
8
Video SynthesisLVbench-C 5-min, 40 scenes
Semantic Alignment Score19.76
8
Long Video SynthesisVBench Long
Character Consistency4.89
7
Showing 5 of 5 rows

Other info

Follow for update