Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Diagnosing and Correcting Concept Omission in Multimodal Diffusion Transformers

About

Multimodal Diffusion Transformers (MM-DiTs) have achieved remarkable progress in text-to-image generation, yet they frequently suffer from concept omission, where specified objects or attributes fail to emerge in the generated image. By performing linear probing on text tokens, we demonstrate that text embeddings can distinguish a characteristic `omission signal' representing the absence of target concepts. Leveraging this insight, we propose Omission Signal Intervention (OSI), which amplifies the omission signal to actively catalyze the generation of missing concepts. Comprehensive experiments on FLUX.1-Dev and SD3.5-Medium demonstrate that OSI significantly alleviates concept omission even in extreme scenarios.

Kanghyun Baek, Jaihyun Lew, Chaehun Shin, Jungbeom Lee, Sungroh Yoon• 2026

Related benchmarks

TaskDatasetResultRank
Text-to-Image GenerationGenEval
Accuracy (2 objects)92
7
Attribute BindingT2I-CompBench attribute binding
Color Binding Score80.48
7
Text-to-Image GenerationT2I-CompBench
Non-spatial Fidelity0.3159
7
Image Quality AssessmentGenEval
MUSIQ Score75.38
7
Image Quality AssessmentT2I-CompBench
MUSIQ72.64
7
Showing 5 of 5 rows

Other info

Follow for update