Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

VINO: A Unified Visual Generator with Interleaved OmniModal Context

About

We present VINO, a unified visual generator that performs image and video generation and editing within a single framework. Instead of relying on task-specific models or independent modules for each modality, VINO uses a shared diffusion backbone that conditions on text, images and videos, enabling a broad range of visual creation and editing tasks under one model. Specifically, VINO couples a vision-language model (VLM) with a Multimodal Diffusion Transformer (MMDiT), where multimodal inputs are encoded as interleaved conditioning tokens, and then used to guide the diffusion process. This design supports multi-reference grounding, long-form instruction following, and coherent identity preservation across static and dynamic content, while avoiding modality-specific architectural components. To train such a unified system, we introduce a multi-stage training pipeline that progressively expands a video generation base model into a unified, multi-task generator capable of both image and video input and output. Across diverse generation and editing benchmarks, VINO demonstrates strong visual quality, faithful instruction following, improved reference and attribute preservation, and more controllable multi-identity edits. Our results highlight a practical path toward scalable unified visual generation, and the promise of interleaved, in-context computation as a foundation for general-purpose visual creation.

Junyi Chen, Tong He, Zhoujie Fu, Pengfei Wan, Kun Gai, Weicai Ye• 2026

Related benchmarks

TaskDatasetResultRank
Text-to-Image GenerationGenEval (test)
Two Obj. Acc88
169
Text-to-Video GenerationVBench
Quality Score84
111
Video UnderstandingVideo-MME without subtitles
Overall Score69.3
67
Vision UnderstandingMMMU
Overall Score67.4
28
Video EditingOpenVE-Bench (test)
Overall Score4.34
16
Image EditingImgEdit
Average Score4.18
10
Visual UnderstandingMMBench-EN (full)
Score83.9
9
Image EditingGEdit Style change
G_SC8.05
9
Image EditingGEdit Average
G_SC7.26
9
Image EditingGEdit Subject replace
G_SC8.22
9
Showing 10 of 14 rows

Other info

GitHub

Follow for update