Our new X account is live! Follow @wizwand_team for updates

Text-to-Image Generation on GenEval (Compositional Metrics including IAA, IQA, ISTA)

97Two Objects

Lumina-DiMOO

Updated 3d ago

Evaluation Results

Method
Lumina-DiMOO 2025.12	97	100	89	93	87	80	91	-	-	-	-
Lumina-DiMOO 2025.12	97	100	91	94	89	82	92	-	-	-	-
OmniGen2 2025.12	96	99	74	98	71	75	86	54.2	75.16	34.48	54.61
Uni-CoT 2025.12	95	99	82	89	60	72	83	-	-	-	-
VACoT 2025.12	95	99	80	90	66	71	84	-	-	-	-
BAGEL 2025.12	94	99	81	88	64	63	82	58.68	71.24	38.35	56.09
Lumina-DiMOO 2025.12	94	100	85	89	85	76	88	51.93	71.98	30.86	51.59
SD3-Medium 2025.12	94	99	72	89	33	60	74	-	-	-	-
BAGEL 2025.12	94	99	81	88	64	63	82	-	-	-	-
Lumina-DiMOO 2025.12	94	100	84	92	86	79	89	-	-	-	-
FLUX.1-dev 2025.12	93	98	75	93	68	65	82	-	-	-	-
Lumina-DiMOO 2025.12	93	100	81	90	83	76	87	-	-	-	-
GPT-Image-1 2025.12	92	99	85	92	75	61	84	69.07	76.74	51.26	65.69
Qwen-Image 2025.12	92	99	89	88	76	77	87	52.02	74.44	34.13	53.53
BAGEL 2025.12	92	99	78	87	53	64	79	-	-	-	-
UiG 2025.12	92	99	81	89	61	69	82	-	-	-	-
GPT-4o 2025.12	92	99	85	92	75	61	84	-	-	-	-
Qwen-Image 2025.12	92	99	89	88	76	77	87	-	-	-	-
Meissonic + MaskFocus 2025.12	91	100	85	87	42	54	76	-	-	-	-
SimpleAR-1.5B 2025.12	90	-	-	-	28	45	63	-	-	-	-
Mask-GRPO 2025.12	90	99	69	85	35	59	73	-	-	-	-
Infinity-8B 2025.12	90	-	-	67	62	-	79	-	-	-	-
Janus-Pro-7B 2025.12	89	99	59	90	79	66	80	-	-	-	-
Janus-Pro 2025.12	89	99	59	90	79	66	80	-	-	-	-
DALL-E 3 2025.12	87	96	47	83	43	45	67	-	-	-	-
DALL-E 3 2025.12	87	96	47	83	43	45	67	-	-	-	-
Meissonic + MaskGRPO 2025.12	87	100	83	87	39	48	73	-	-	-	-
StageVAR 2025.12	87	-	-	66	60	-	78	-	-	-	-
OmniGen 2025.12	86	99	64	85	31	55	70	58.84	75.62	41	58.49
Lumina-DiMOO 2025.12	85	96	70	85	72	62	78	-	-	-	-
Infinity-2B 2025.12	85	-	-	54	45	-	73	-	-	-	-
SkipVAR 2025.12	84	-	-	60	39	-	72	-	-	-	-
StageVAR 2025.12	84	-	-	56	43	-	72	-	-	-	-
Janus-Pro-1B 2025.12	82	98	51	89	65	56	73	-	-	-	-
FLUX.1-dev 2025.12	81	98	74	79	22	45	66	64.24	74.96	41.14	60.11
FLUX.1-dev 2025.12	81	99	75	80	21	48	67	-	-	-	-
MMaDA 2025.12	81	99	52	92	33	37	66	-	-	-	-
FLUX.1-dev 2025.12	81	98	74	79	22	45	66	-	-	-	-
Emu3 (+Rewriter) 2025.12	81	99	42	80	49	45	66	-	-	-	-
Emu3 2025.12	81	-	-	45	49	-	66	-	-	-	-
FastVAR 2025.12	81	-	-	52	45	-	72	-	-	-	-
Show-o 2025.12	80	98	66	84	31	50	68	-	-	-	-
Show-o 2025.12	80	98	66	84	31	50	68	-	-	-	-
Show-o 2025.12	80	-	-	50	31	-	68	-	-	-	-
SD3.5-M 2025.12	78	98	50	81	24	52	63	-	-	-	-
SANA-1.6B 2025.12	77	99	62	88	21	47	66	34.34	35.11	31.22	33.56
MMaDA 2025.12	77	99	50	91	29	36	64	-	-	-	-
Muddit 2025.12	76	99	62	88	25	44	67	-	-	-	-
MMaDA 2025.12	75	99	48	90	27	32	62	-	-	-	-
Show-o+PARM 2025.12	75	97	60	83	54	53	69	-	-	-	-
SDXL 2025.12	74	98	39	85	15	23	55	-	-	-	-
SDXL 2025.12	74	98	39	85	15	23	55	-	-	-	-
SDXL 2025.12	74	-	-	23	15	-	55	-	-	-	-
MMaDA 2025.12	73	98	47	88	25	31	60	-	-	-	-
Muddit 2025.12	73	99	60	89	24	42	65	-	-	-	-
Emu3-Gen 2025.12	71	98	34	81	17	21	54	-	-	-	-
Muddit 2025.12	71	99	59	88	24	41	64	-	-	-	-
Confidence 2026.02	69.7	93.8	46.3	81.9	16	27	-	-	-	-	0.56
Margin 2026.02	68.7	94	47.3	80.1	19	29	-	-	-	-	0.563
Info-Gain Sampler 2026.02	68.7	97.5	47.5	79.8	25	32	-	-	-	-	0.582
Muddit 2025.12	68	98	59	86	22	39	62	-	-	-	-
Entropy 2026.02	67.3	94.3	46	79.9	17.8	26.8	-	-	-	-	0.553
Uniform 2026.02	66.7	94.1	38.4	78.2	19	28.8	-	-	-	-	0.542
Meissonic 2025.12	66	99	42	86	10	22	54	-	-	-	-
FLUX.1-LITE 2025.12	65.4	98.44	29.69	78.19	13.5	36.25	53.58	-	-	-	-
MeanFlow 2025.12	64.14	96.25	38.44	69.15	13	27.5	51.41	-	-	-	-
Rescaled 2025.12	63.89	97.81	39.06	74.73	12.5	33.5	53.58	-	-	-	-
PixArt-Sigma 2025.12	62	-	-	27	14	-	55	-	-	-	-
HART 2025.12	62	-	-	18	13	-	51	-	-	-	-
TokenFlow-XL 2025.12	60	95	41	81	16	24	55	-	-	-	-
MMaDA 2025.12	60	94	32	76	19	22	51	-	-	-	-
JanusFlow 2025.12	59	97	45	83	53	42	63	-	-	-	-
SEED-X 2025.12	58	97	26	80	19	14	49	-	-	-	-
sCM 2025.12	56.82	97.19	35.62	76.86	8.75	38.5	52.29	-	-	-	-
sCM 2025.12	55.81	94.69	38.44	74.2	10.25	43.5	52.81	-	-	-	-
STAR 2025.12	54	-	-	8	9	-	51	-	-	-	-
StageVAR 2025.12	54	-	-	9	8	-	51	-	-	-	-
Muddit 2025.12	53	95	48	80	13	29	53	-	-	-	-
SD2.1 2025.12	51	98	44	85	7	17	50	-	-	-	-
PixArt-α 2025.12	50	98	44	80	8	7	32	-	-	-	-
SD1.5 2025.12	38	97	35	76	4	6	43	-	-	-	-
sCM 2025.12	36.87	89.69	26.56	67.55	6.5	32.5	43.28	-	-	-	-
LlamaGen 2025.12	34	71	21	58	7	4	32	-	-	-	-
LlamaGen 2025.12	34	-	-	4	7	-	32	-	-	-	-
MeanFlow 2025.12	31.31	61.88	18.12	39.89	7.25	18.5	29.49	-	-	-	-
LDM 2025.12	29	92	23	70	2	5	37	-	-	-	-
MeanFlow 2025.12	0.25	2.81	0.31	0.8	0.25	0.25	0.78	-	-	-	-
MetaQuery-XL 2025.12	-	-	-	-	-	-	80	-	-	-	-
SD 3.5 2025.12	-	-	50	-	-	-	-	-	-	-	0.64
SD 3.5-ft-20k 2025.12	-	-	51	-	-	-	-	-	-	-	0.64
SD 3.5-ft-10k 2025.12	-	-	51	-	-	-	-	-	-	-	0.64
SD 3.5-ft-10k + MixFlow 2025.12	-	-	62	-	-	-	-	-	-	-	0.66
SD 3.5 2025.12	-	-	47	-	-	-	-	-	-	-	0.62
SD 3.5-ft-20k 2025.12	-	-	48	-	-	-	-	-	-	-	0.62
SD 3.5-ft-10k 2025.12	-	-	48	-	-	-	-	-	-	-	0.62
SD 3.5-ft-10k + MixFlow 2025.12	-	-	59	-	-	-	-	-	-	-	0.65
Chameleon 2025.12	-	-	-	-	-	-	39	-	-	-	-
DALL-E 3 2025.12	-	-	-	-	-	-	67	-	-	-	-