Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoning

About

While proprietary systems such as Seedance-2.0 have achieved remarkable success in omni-capable video generation, open-source alternatives significantly lag behind. Most academic models remain heavily fragmented, and the few existing efforts toward unified video generation still struggle to seamlessly integrate diverse tasks within a single framework. To bridge this gap, we propose OmniWeaving, an omni-level video generation model featuring powerful multimodal composition and reasoning-informed capabilities. By leveraging a massive-scale pretraining dataset that encompasses diverse compositional and reasoning-augmented scenarios, OmniWeaving learns to temporally bind interleaved text, multi-image, and video inputs while acting as an intelligent agent to infer complex user intentions for sophisticated video creation. Furthermore, we introduce IntelligentVBench, the first comprehensive benchmark designed to rigorously assess next-level intelligent unified video generation. Extensive experiments demonstrate that OmniWeaving achieves SoTA performance among open-source unified models. The codes and model have already been publicly available. Project Page: https://omniweaving.github.io.

Kaihang Pan, Qi Tian, Jianwei Zhang, Weijie Kong, Jiangfeng Xiong, Yanxin Long, Shixue Zhang, Haiyi Qiu, Tan Wang, Zheqi Lv, Yue Wu, Liefeng Bo, Siliang Tang, Zhao Zhong• 2026

Related benchmarks

TaskDatasetResultRank
Text-to-Video GenerationVBench
Quality Score84.37
155
Video EditingOpenVE-Bench
Overall Score3.15
22
Implicit Image-to-Video (Implicit I2V)IntelligentVBench
IF Score4.33
12
Compositional Multi-Image-to-Video GenerationIntelligentVBench 1Subject with BKG
IF4.35
10
Compositional Multi-Image-to-Video GenerationIntelligentVBench 2Subjects with BKG
IF Score4.08
10
Compositional Multi-Image-to-Video GenerationIntelligentVBench 3Subjects with BKG
IF3.53
10
Interpolative Directed Image-to-Video (Interpolative DI2V)IntelligentVBench
IF4.74
8
Text-Instruction Video-to-Video (TIV2V)IntelligentVBench
IF4
6
Showing 8 of 8 rows

Other info

Follow for update