HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narratives
About
State-of-the-art text-to-video models excel at generating isolated clips but fall short of creating the coherent, multi-shot narratives, which are the essence of storytelling. We bridge this "narrative gap" with HoloCine, a model that generates entire scenes holistically to ensure global consistency from the first shot to the last. Our architecture achieves precise directorial control through a Window Cross-Attention mechanism that localizes text prompts to specific shots, while a Sparse Inter-Shot Self-Attention pattern (dense within shots but sparse between them) ensures the efficiency required for minute-scale generation. Beyond setting a new state-of-the-art in narrative coherence, HoloCine develops remarkable emergent abilities: a persistent memory for characters and scenes, and an intuitive grasp of cinematic techniques. Our work marks a pivotal shift from clip synthesis towards automated filmmaking, making end-to-end cinematic creation a tangible future. Our code is available at: https://holo-cine.github.io/.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Video Generation Quality Evaluation | EvalVerse | Machine Win Ratio81 | 172 | |
| Multi-Shot Audio-Video Generation | CineBench | Audio Quality (AQ)0.5 | 13 | |
| Multi-shot cinematic audio-video generation | CineBench Human Evaluation 1.0 | Video Quality3.18 | 13 | |
| Text-to-Video | ShotVerse-Bench | Motion Type Appropriateness4.324 | 12 | |
| Multi-shot Video Generation | GroundBench | ARC Score0.368 | 10 | |
| Multi-shot Video Generation | ShotVerse-Bench | Semantic Consistency (Global)0.297 | 7 | |
| Multi-shot Video Generation | GroundBench (40 randomly sampled scripts) | Identity Score3.62 | 5 | |
| Multi-shot video storytelling | ST-Bench | Aesthetic Quality56.53 | 5 | |
| Intra-shot prompt-following alignment | Pillar 2 Intra-shot prompt-following alignment | Intra-shot Character Presence88.2 | 4 | |
| Multi-shot long video generation | StoryBench 1.0 (test) | Avg Cross-shot Consistency66.5 | 4 |