Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

T2I-CompBench

Benchmarks

Task NameDataset NameSOTA ResultTrend
Text-to-Image GenerationT2I-CompBench
Shape Fidelity73.66
185
Text-to-Image GenerationT2I-CompBench++
Color0.8677
95
Text-to-Image GenerationT2I-CompBench (test)
Color Accuracy91
86
Text-to-Image GenerationT2I-CompBench
Color Fidelity84.47
46
Text-to-Image Compositional AlignmentT2I-CompBench++ v2 (test)
Color86.97
37
Text-to-Image GenerationT2I-CompBench
T2I-CompBench Score0.4625
27
Compositional Text-to-Image GenerationT2I-CompBench
Color Accuracy0.7935
16
Text-to-Image GenerationT2I-CompBench
B-VQA Score75
16
Controllable Image Generation (Counting)T2I-CompBench Single Category
Counting MAE1.23
15
Text-to-Image GenerationT2I-CompBench 1.0 (test)
CLIP Score0.344
14
Compositional Text-to-Image GenerationT2I-CompBench v1.0 (test)
Color Score86.92
13
Text-to-image generationT2I-CompBench++ v1.0 (test)
Color Score (B-VQA)73.23
12
Text-to-Image GenerationT2I-CompBench
Evaluation Time (min)5
12
Text-to-Image CompositionalityT2I-CompBench (test)
Color Accuracy78.59
11
Text-to-Image GenerationT2I-CompBench
Color Score84.2
10
Text-to-ImageT2I-CompBench
Color Fidelity75.68
9
Text-to-Image AlignmentT2I-Compbench
T2I-Compbench Alignment0.5064
9
Text-to-Image GenerationT2I-CompBench
DINO Score0.799
9
Text-to-Image GenerationT2I-CompBench color set
2 Objects Exist76.3
9
Text-to-Image GenerationT2I-CompBench
Color Fidelity84.11
8
Text-to-Image GenerationT2I-CompBench
Non-spatial Fidelity0.3164
7
Image Quality AssessmentT2I-CompBench
MUSIQ73.29
7
Attribute BindingT2I-CompBench attribute binding
Color Binding Score81.59
7
Text-to-Image GenerationT2I-CompBench out-of-domain
Semantic Consistency51.37
7
Text-to-image GenerationT2I-Compbench Count
Human Accuracy48
7
Showing 25 of 45 rows