Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generation

About

Recent advances in multimodal generative models have unlocked photorealistic, instruction-aligned image generation, yet leading systems like GPT-4o-Image remain proprietary and inaccessible. To democratize these capabilities, we present ShareGPT-4o-Image, the first dataset comprising 45K text-to-image and 46K text-and-image-to-image data, all synthesized using GPT-4o's image generation capabilities for distilling its advanced image generation abilities. Leveraging this dataset, we develop Janus-4o, a multimodal large language model capable of both text-to-image and text-and-image-to-image generation. Janus-4o not only significantly improves text-to-image generation over its predecessor, Janus-Pro, but also newly supports text-and-image-to-image generation. Notably, it achieves impressive performance in text-and-image-to-image generation from scratch, using only 91K synthetic samples and 6 hours of training on an 8 A800-GPU machine. We hope the release of ShareGPT-4o-Image and Janus-4o will foster open research in photorealistic, instruction-aligned image generation.

Junying Chen, Zhenyang Cai, Pengcheng Chen, Shunian Chen, Ke Ji, Xidong Wang, Yunjin Yang, Benyou Wang• 2025

Related benchmarks

TaskDatasetResultRank
Image EditingGEdit-Bench-EN (full)
G-Score (O)3.83
66
Single-image editingGEdit EN (full)
BG Change7.17
42
Instruction-based Image EditingRISEBench 49 (test)
Reasoning36.67
27
Instruction-based Image EditingKRIS Bench 38 (test)
Factual Score66.92
27
Text-to-Image GenerationNegGenBench (test)
Positive Score92.5
22
Image EditingImgEdit (test)
Add Score3.6
16
Image EditingGEdit-Bench-EN Intersection
SC Score4.69
10
Image EditingGEdit-Bench EN Full set
BC Score4.31
4
Showing 8 of 8 rows

Other info

Follow for update