Share your thoughts, 1 month free Claude Pro on usSee more

Text-to-Image Generation on T2I-CompBench++

31.97Non-Spatial

PixArt-α

Updated 23d ago

Evaluation Results

Method
PixArt-α 2024.12	31.97	-	-	-	-	-	-	0.6031	36.74	34.33	-	-	-	-	-	-
SD-v2 2024.12	31.27	-	-	-	-	-	-	0.4736	30.5	33.86	-	-	-	-	-	-
SDXL 2024.12	31.19	-	-	-	-	-	-	0.5288	35.62	32.37	-	-	-	-	-	-
SILMM 2024.12	30.51	-	-	-	-	-	-	0.5971	36.03	33.93	-	-	-	-	-	-
Emu3 2024.12	30.15	-	-	-	-	-	-	0.4479	32.3	31.32	-	-	-	-	-	-
DALL-E 3 2024.12	30.03	-	-	-	-	-	-	0.7009	41.63	37.73	-	-	-	-	-	-
SILMM 2024.12	29.82	-	-	-	-	-	-	0.396	25.11	28.28	-	-	-	-	-	-
SILMM 2024.12	29	-	-	-	-	-	-	0.3994	27.63	26.43	-	-	-	-	-	-
SEED-LLaMA 2024.12	28.86	-	-	-	-	-	-	0.192	20.29	21.46	-	-	-	-	-	-
DreamLLM 2024.12	28.76	-	-	-	-	-	-	0.2294	23.74	23.01	-	-	-	-	-	-
SD 3 (2B) + CTCAL 2026.03	0.7867	0.8443	0.5968	0.7581	0.3476	0.4117	0.6292	-	-	0.3814	-	-	-	-	-	-
DALL-E 3 2026.03	0.7853	0.7785	0.6205	0.7036	0.2865	0.3744	0.5926	-	-	0.3773	-	-	-	-	-	-
FLUX-schnell 2026.03	0.7809	0.7407	0.5718	0.6922	0.2863	0.3866	0.6185	-	-	0.3703	-	-	-	-	-	-
SD 3 (2B) 2026.03	0.7782	0.8132	0.5885	0.7334	0.32	0.4084	0.6174	-	-	0.3771	-	-	-	-	-	-
Pixart-α-ft 2026.03	0.7747	0.669	0.4927	0.6477	0.2064	0.3901	0.5032	-	-	0.3433	-	-	-	-	-	-
SD 2.1 + CTCAL 2026.03	0.7723	0.7233	0.5149	0.6754	0.2142	0.3862	0.5084	-	-	0.3403	-	-	-	-	-	-
SD 3 (2B) + CORS 2026.03	0.7708	0.8236	0.5833	0.7398	0.3232	0.4033	0.628	-	-	0.3739	-	-	-	-	-	-
SD XL 2026.03	0.7673	0.5879	0.4687	0.5299	0.2133	0.3566	0.4991	-	-	0.3237	-	-	-	-	-	-
SD 2.1 + GORS 2026.03	0.7637	0.6603	0.4785	0.6287	0.1815	0.3572	0.483	-	-	0.3328	-	-	-	-	-	-
SD 2.1 + GORS 2026.03	0.7621	0.6426	0.4864	0.6319	0.1775	0.3475	0.4856	-	-	0.3371	-	-	-	-	-	-
SD 2.1 + AE 2026.03	0.7593	0.64	0.4517	0.5963	0.1455	0.3222	0.4773	-	-	0.3401	-	-	-	-	-	-
SD 2.1 2026.03	0.7567	0.5065	0.4221	0.4922	0.1342	0.323	0.4582	-	-	0.3386	-	-	-	-	-	-
SD 2.1 + SD 2026.03	0.756	0.499	0.4218	0.49	0.1386	0.3224	0.4557	-	-	0.3355	-	-	-	-	-	-
SD 1.4 2026.03	0.7487	0.3765	0.3576	0.4156	0.1246	0.303	0.4456	-	-	0.308	-	-	-	-	-	-
SD 2.1 + CD 2026.03	0.6927	0.4063	0.3299	0.3645	0.08	0.2847	0.4272	-	-	0.2898	-	-	-	-	-	-
Prompt Reinjection 2026.02	0.3197	0.832	0.6532	0.7789	0.3003	0.3967	-	-	-	-	0.6398	-	-	-	-	-
SD3.5-M+Flow-GRPO 2025.05	0.3195	0.8379	0.613	0.7236	0.5447	0.4471	0.6752	-	-	-	-	-	-	-	-	-
Qwen-Image 2026.03	0.3185	0.845	0.6242	0.7636	0.4659	0.4611	0.7677	-	-	0.3848	-	-	-	-	-	-
SD3.5 2026.02	0.3179	0.7809	0.6084	0.7296	0.2894	0.3858	-	-	-	-	0.6368	-	-	-	-	-
Qwen-Image 2026.03	0.3171	0.828	0.5986	0.7451	0.443	0.4536	0.7582	-	-	0.3838	-	-	-	-	-	-
SD3.5 + Ours 2026.01	0.3169	0.8052	0.6744	0.8428	0.3647	0.3923	-	-	-	0.4047	0.6088	28.9501	5.9401	-	-	-
Prompt Reinjection 2026.02	0.3166	0.8508	0.6138	0.7584	0.4594	0.4587	-	-	-	-	0.7764	-	-	-	-	-
Qwen Image 2026.02	0.3163	0.8419	0.5978	0.7487	0.4536	0.4575	-	-	-	-	0.754	-	-	-	-	-
Janus-Pro + OSPO 2025.05	0.3161	0.8567	0.6386	0.7727	0.3562	0.3926	0.5908	-	-	0.4147	-	-	-	-	-	-
Janus-Pro + OSPO 2025.05	0.3158	0.8349	0.5763	0.7274	0.3077	0.4029	0.5653	-	-	0.3935	-	-	-	-	-	-
SD3.5-M 2025.05	0.3146	0.7994	0.5669	0.7338	0.285	0.3739	0.5927	-	-	-	-	-	-	-	-	-
Janus-Pro + SUDER 2025.05	0.3141	0.7824	0.5786	0.7292	0.2524	-	-	-	-	0.3858	-	-	-	-	-	-
Prompt Reinjection 2026.02	0.314	0.8416	0.5965	0.7496	0.3044	0.4147	-	-	-	-	0.6056	-	-	-	-	-
Janus-Pro-7B 2025.05	0.3137	0.5145	0.3323	0.4069	0.1566	0.2753	0.4406	-	-	-	-	-	-	-	-	-
Janus-Pro-7B 2026.03	0.3135	0.7933	0.501	0.6752	0.3246	-	0.5408	-	-	0.3888	-	-	-	-	-	-
Unitok-MLLM 2025.05	0.3131	0.7745	0.5195	0.6431	0.2668	0.4088	0.5675	-	-	0.3617	-	-	-	-	-	-
Janus-Pro + SUDER 2025.05	0.313	0.7765	0.5106	0.6767	0.2464	-	-	-	-	0.3657	-	-	-	-	-	-
BAGEL 2026.03	0.3128	0.8269	0.6194	0.7455	0.3808	0.4369	0.67	-	-	0.3879	-	-	-	-	-	-
FLUX.1 Dev 2025.05	0.3127	0.7407	0.5718	0.6922	0.2863	0.3866	0.6185	-	-	-	-	-	-	-	-	-
FLUX.1 2025.05	0.3127	0.7407	0.5718	0.6922	0.2863	-	-	-	-	0.3703	-	-	-	-	-	-
Janus-Pro-7B 2026.03	0.3127	0.5202	0.3272	0.4039	0.1573	0.2737	0.445	-	-	0.3798	-	-	-	-	-	-
Qwen Image + Ours 2026.01	0.3123	0.8677	0.6348	0.7796	0.456	0.4202	-	-	-	0.4104	0.7616	29.0212	6.2378	-	-	-
Janus-Pro + SILMM 2025.05	0.3122	0.6097	0.3164	0.4474	0.1539	0.2632	0.2826	-	-	0.3679	-	-	-	-	-	-
SD3.5 2026.01	0.3118	0.7284	0.5592	0.7471	0.2866	0.3816	-	-	-	0.3727	0.5969	29.2869	6.0978	-	-	-
SD3 2026.02	0.3114	0.7929	0.5704	0.7092	0.2913	0.4061	-	-	-	-	0.605	-	-	-	-	-
TACA 2026.01	0.3114	0.7434	0.5784	0.7444	0.2947	0.3839	-	-	-	0.382	0.6029	29.3225	6.2297	-	-	-
Janus-Pro + SILMM 2025.05	0.3113	0.7394	0.4325	0.5796	0.2105	0.3572	0.5073	-	-	0.3725	-	-	-	-	-	-
BAGEL 2026.03	0.3111	0.8081	0.5794	0.7154	0.3403	0.3778	0.6552	-	-	0.3778	-	-	-	-	-	-
Qwen Image 2026.01	0.311	0.8554	0.6358	0.765	0.3973	0.4077	-	-	-	0.3983	0.7406	28.8831	6.1925	-	-	-
SD-XL 2025.05	0.311	0.6369	0.5408	0.5637	0.2032	-	-	-	-	0.4091	-	-	-	-	-	-
Janus-Pro 2025.05	0.3109	0.5215	0.3272	0.405	0.1654	0.2679	0.4431	-	-	0.3868	-	-	-	-	-	-
Prompt Reinjection 2026.02	0.3079	0.7866	0.5172	0.6493	0.2779	0.4095	-	-	-	-	0.6292	-	-	-	-	-
FLUX 2026.02	0.3069	0.7546	0.5086	0.6307	0.2765	0.4036	-	-	-	-	0.6134	-	-	-	-	-
FLUX + Ours 2026.01	0.3054	0.7804	0.5482	0.698	0.328	0.39	-	-	-	0.3691	0.6091	29.2267	6.411	-	-	-
TACA 2026.01	0.3045	0.7535	0.5126	0.6522	0.3043	0.3814	-	-	-	0.3619	0.5855	29.1525	6.3327	-	-	-
FLUX 2026.01	0.3044	0.7322	0.4908	0.649	0.2935	0.3739	-	-	-	0.3597	0.5877	29.1586	6.3563	-	-	-
TACA 2026.01	0.3034	0.7296	0.4898	0.6549	0.2991	0.379	-	-	-	0.3585	0.578	29.1375	6.3205	-	-	-
DALL-E 3 2025.05	0.3003	0.7785	0.6205	0.7036	0.2865	-	-	-	-	0.3773	-	-	-	-	-	-
Show-o 2025.05	0.3	0.56	0.41	0.46	0.2	-	-	-	-	0.29	-	-	-	-	-	-
Janus-Pro 2025.05	0.2809	0.3542	0.2291	0.2843	0.0756	0.2367	0.2714	-	-	0.2693	-	-	-	-	-	-
EMU3 2025.05	-	0.7913	0.5846	0.7422	-	-	-	-	-	-	-	-	-	-	-	-
SD-v1.5 2024.12	-	-	-	-	-	-	-	0.3865	-	-	-	-	-	-	-	-
DALL-E 2 2024.12	-	-	-	-	-	-	-	0.5863	-	-	-	-	-	-	-	-
SD-v2.1 2024.12	-	-	-	-	-	-	-	0.5057	-	-	-	-	-	-	-	-
SD 2.1 2026.03	-	-	-	-	-	-	-	-	-	-	-	-	5.263	0.618	-	-
SD 2.1 + GORS 2026.03	-	-	-	-	-	-	-	-	-	-	-	-	5.281	0.626	-	-
SD 2.1 + CTCAL 2026.03	-	-	-	-	-	-	-	-	-	-	-	-	5.344	0.623	-	-
SDXL 2026.03	-	-	-	-	-	-	-	-	-	-	-	-	-	-	0.354	31.45
Layout Guidance 2026.03	-	-	-	-	-	-	-	-	-	-	-	-	-	-	0.327	30.46
R&B 2026.03	-	-	-	-	-	-	-	-	-	-	-	-	-	-	0.33	30.04
LaRender 2026.03	-	-	-	-	-	-	-	-	-	-	-	-	-	-	0.378	31.22
DepthArb 2026.03	-	-	-	-	-	-	-	-	-	-	-	-	-	-	0.386	31.68