Deep Forcing: Training-Free Long Video Generation with Deep Sink and Participative Compression
About
Recent advances in autoregressive video diffusion have enabled real-time frame streaming, yet existing solutions still suffer from temporal repetition, drift, and motion deceleration. We find that naively applying StreamingLLM-style attention sinks to video diffusion leads to fidelity degradation and motion stagnation. To overcome this, we introduce Deep Forcing, which consists of two training-free mechanisms that address this without any fine-tuning. Specifically, 1) Deep Sink dedicates half of the sliding window to persistent sink tokens and re-aligns their temporal RoPE phase to the current timeline, stabilizing global context during long rollouts. 2) Participative Compression performs importance-aware KV cache pruning that preserves only tokens actively participating in recent attention while safely discarding redundant and degraded history, minimizing error accumulation under out-of-distribution length generation. Together, these components enable over 12x extrapolation (e.g. 5s-trained to 60s+ generation) with better imaging quality than LongLive, better aesthetic quality than RollingForcing, almost maintaining overall consistency, and substantial gains in dynamic degree, all while maintaining real-time generation. Our results demonstrate that training-free KV-cache management can match or exceed training-based approaches for autoregressively streaming long-video generation.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Long Video Generation | VBench-Long 60 seconds | Subject Consistency97.9 | 74 | |
| Long Video Generation | VBenchLong 30-second | Dynamic Degree97.23 | 22 | |
| Long Video Generation | VBench-Long 30 seconds | Subject Consistency97.52 | 18 | |
| Video Generation | User Study | Interaction Plausibility Score2.6 | 16 | |
| Short Video Generation | VBench-Long 60 seconds | Aesthetic Quality59.63 | 13 | |
| Long Video Generation | VBench-Long 120s generation | Subject Consistency97.17 | 12 | |
| Video Generation | VBench single-prompt 5-second setting | Dynamic Score63.89 | 11 | |
| Video Generation | VBench standard prompt (5s setting) | Dynamic Score63.89 | 11 | |
| Short Video Generation | VBench-Long 30 seconds | Aesthetic Quality59.87 | 10 | |
| Long-horizon Video Generation | VBench 30s | AQ0.621 | 10 |