Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusion

About

Training image generation foundation models consumes substantial resources. Previous methods have attempted to leverage semantic guidance to accelerate the training process, yet their experiments were only conducted on simple datasets such as ImageNet, at low resolutions, and with small-scale models. In this paper, we propose SeFi-Image, a text-to-image foundation model built upon semantic-first diffusion, a novel latent diffusion modeling paradigm. We instantiate SeFi-Image at three model scales, 1B, 2B, and 5B parameters, enabling systematic study of scaling behavior and flexible deployment under varying compute budgets. Notably, our largest 5B model was trained with merely 125K A800 GPU hours, corresponding to roughly 10-20% of the training compute used by Z-Image. However, it achieves results comparable to or even superior to Qwen-Image and Z-Image. Despite this modest training compute, SeFi-Image achieves strong performance on a wide range of benchmarks, including GenEval, DPG, LongTextBench, OneIG, and CVTG-2K. Moreover, we provide DMD2-distilled few-step turbo variants for each model scale to accommodate diverse hardware constraints and latency requirements. We publicly release our code, weights and hope this work offers the community useful insights into semantic-guided diffusion modeling for T2I generation, while also providing practical and readily deployable model options.

Ruoyu Feng, Jinming Liu, Yuqi Wang, Xin Cheng, Boyuan Liu, Shanglin Li, Hanshen Zhu, Wenfeng Lin, Mingyu Guo, Xin Jin• 2026

Related benchmarks

TaskDatasetResultRank
Text-to-Image GenerationGenEval
Overall Score88
914
Text-to-Image GenerationDPG-Bench
Overall Score87.45
510
Text-to-Image GenerationOneIG-ZH
Overall Quality53.79
88
Text-to-Image GenerationOneIG EN
Overall Quality56.06
50
Long-text-to-Image GenerationLongText-Bench
EN Score97.8
42
Visual Text GenerationCVTG-2K
NED94.3
14
VAE ReconstructionOmniDoc-TokenBench (test)
PSNR30.91
7
Compositional ReasoningDPG-Bench
Overall Score87.31
7
Showing 8 of 8 rows

Other info

Follow for update