Diagnosing and Correcting Concept Omission in Multimodal Diffusion Transformers
About
Multimodal Diffusion Transformers (MM-DiTs) have achieved remarkable progress in text-to-image generation, yet they frequently suffer from concept omission, where specified objects or attributes fail to emerge in the generated image. By performing linear probing on text tokens, we demonstrate that text embeddings can distinguish a characteristic `omission signal' representing the absence of target concepts. Leveraging this insight, we propose Omission Signal Intervention (OSI), which amplifies the omission signal to actively catalyze the generation of missing concepts. Comprehensive experiments on FLUX.1-Dev and SD3.5-Medium demonstrate that OSI significantly alleviates concept omission even in extreme scenarios.
Kanghyun Baek, Jaihyun Lew, Chaehun Shin, Jungbeom Lee, Sungroh Yoon• 2026
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Text-to-Image Generation | GenEval | Accuracy (2 objects)92 | 7 | |
| Attribute Binding | T2I-CompBench attribute binding | Color Binding Score80.48 | 7 | |
| Text-to-Image Generation | T2I-CompBench | Non-spatial Fidelity0.3159 | 7 | |
| Image Quality Assessment | GenEval | MUSIQ Score75.38 | 7 | |
| Image Quality Assessment | T2I-CompBench | MUSIQ72.64 | 7 |
Showing 5 of 5 rows