Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Meissonic: Revitalizing Masked Generative Transformers for Efficient High-Resolution Text-to-Image Synthesis

About

We present Meissonic, which elevates non-autoregressive masked image modeling (MIM) text-to-image to a level comparable with state-of-the-art diffusion models like SDXL. By incorporating a comprehensive suite of architectural innovations, advanced positional encoding strategies, and optimized sampling conditions, Meissonic substantially improves MIM's performance and efficiency. Additionally, we leverage high-quality training data, integrate micro-conditions informed by human preference scores, and employ feature compression layers to further enhance image fidelity and resolution. Our model not only matches but often exceeds the performance of existing models like SDXL in generating high-quality, high-resolution images. Extensive experiments validate Meissonic's capabilities, demonstrating its potential as a new standard in text-to-image synthesis. We release a model checkpoint capable of producing $1024 \times 1024$ resolution images.

Jinbin Bai, Tian Ye, Wei Chow, Enxin Song, Xiangtai Li, Zhen Dong, Lei Zhu, Shuicheng Yan• 2024

Related benchmarks

TaskDatasetResultRank
Text-to-Image GenerationGenEval
Overall Score54
704
Text-to-Image GenerationDPG
Overall Score65.3
256
Text-to-Image GenerationGenEval
Overall Score54
218
Text-to-Image GenerationMS-COCO
FID22.64
145
Text-to-Image GenerationHPS v2.1
Overall Score29.63
96
Text-to-Image GenerationImageReward
ImageReward Score0.942
69
Image GenerationGenEval
Overall GenEval Score54
65
Text-to-Image GenerationHPS v2.0
Animation Score29.57
17
Text-to-Image GenerationGenEval zero-shot
GenEval Score0.47
8
Text-to-Image GenerationHPS Prompts (test)
HPSv2.1 (Mean)0.281
6
Showing 10 of 12 rows

Other info

Follow for update