SOTA Compositional Image Generation benchmarks and papers with code

Benchmarks

Dataset Name	SOTA Method	Metric
GenEval	SDv1.4	Overall Score60.8	94	23d ago
ComplexCompo 300	Ours-LoRA	CLIP-I0.7999	20	4mo ago
Positional CLEVR 1 Component	Composed Parallel Token Prediction	Error (%)0.7	14	3mo ago
Relational CLEVR 1 Component	Composed Parallel Token Prediction	Error Rate (%)21.84	14	3mo ago
FFHQ 1 Component	Composed Parallel Token Prediction	Error Rate (%)0.22	14	3mo ago
COCO-MIG Avg	MIGC	Instance Attribute Success Ratio60.41	14	4mo ago
COCO-MIG L6	MIGC	Instance Attribute Success Ratio0.5913	14	4mo ago
COCO-MIG L5	MIGC	Instance Attribute Success Ratio57.25	14	4mo ago
COCO-MIG L4	MIGC	Instance Attribute Success Ratio61.27	14	4mo ago
COCO-MIG L3	MIGC	Instance Attribute Success Ratio63.1	14	4mo ago
COCO-MIG L2	InstanceDiffusion	Instance Attr Success Ratio68.24	14	4mo ago
Positional CLEVR 3 Components	Composed Parallel Token Prediction	Error Rate (%)4.96	12	3mo ago
Positional CLEVR 2 Components	Composed Parallel Token Prediction	Error Rate (%)1.82	12	3mo ago
Relational CLEVR 3 Components	Composed Parallel Token Prediction	Error Rate (%)85.7	12	3mo ago
Relational CLEVR 2 Components	Composed Parallel Token Prediction	Error Rate56.94	12	3mo ago
FFHQ (3 Components)	Composed Parallel Token Prediction	Error (%)0.82	12	3mo ago
FFHQ 2 Components	Composed Parallel Token Prediction	Error Rate (%)0.62	12	3mo ago
DrawBench	CRD	Aesthetics Score5.44	9	4mo ago
Compositional Image Generation DrawBench (test)	TMPO	GenEval0.949	6	2mo ago
DreamEditBench 220	Ours-LoRA	CLIP-I0.8125	6	4mo ago
ComposLoRA	W-Switch	ICLIP (N=2)76.23	5	1mo ago
DrawBench Held-out (test)	RAM	GenEval97	5	2mo ago
CelebA 23 OOD compositions (General)	PoE	FID140.3	5	2mo ago
CelebA 23 OOD compositions (Faithful)		FID107.5	5	2mo ago
EvalGen	OP-GRPO	EvalGen Score0.96	5	3mo ago

Showing 25 of 30 rows