Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

OminiControl2: Efficient Conditioning for Diffusion Transformers

About

Fine-grained control of text-to-image diffusion transformer models (DiT) remains a critical challenge for practical deployment. While recent advances such as OminiControl and others have enabled a controllable generation of diverse control signals, these methods face significant computational inefficiency when handling long conditional inputs. We present OminiControl2, an efficient framework that achieves efficient image-conditional image generation. OminiControl2 introduces two key innovations: (1) a dynamic compression strategy that streamlines conditional inputs by preserving only the most semantically relevant tokens during generation, and (2) a conditional feature reuse mechanism that computes condition token features only once and reuses them across denoising steps. These architectural improvements preserve the original framework's parameter efficiency and multi-modal versatility while dramatically reducing computational costs. Our experiments demonstrate that OminiControl2 reduces conditional processing overhead by over 90% compared to its predecessor, achieving an overall 5.9$\times$ speedup in multi-conditional generation scenarios. This efficiency enables the practical implementation of complex, multi-modal control for high-quality image synthesis with DiT models.

Zhenxiong Tan, Qiaochu Xue, Xingyi Yang, Songhua Liu, Xinchao Wang• 2025

Related benchmarks

TaskDatasetResultRank
Product poster generationInnoComposer-Bench 1.0 (test)
IR-Score0.93
14
Multi-condition Image Generation (Multi-Spatial)Multi-Spatial Evaluation Set
FID71.87
6
Multi-condition Image Generation (Subject-Canny)Subject-Canny (Evaluation Set)
FID72.03
4
Multi-condition Image Generation (Subject-Depth)Subject-Depth Evaluation Set
FID80.2
4
Showing 4 of 4 rows

Other info

Follow for update