Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

T2I-CompBench

Benchmarks

Task NameDataset NameSOTA ResultTrend
Text-to-Image GenerationT2I-CompBench
Shape Fidelity73.66
185
Text-to-Image GenerationT2I-CompBench++
Color0.8677
99
Text-to-Image GenerationT2I-CompBench (test)
Color Accuracy91
86
Text-to-Image GenerationT2I-CompBench
Color Fidelity84.47
58
Text-to-Image Compositional AlignmentT2I-CompBench++ v2 (test)
Color86.97
37
Text-to-Image GenerationT2I-CompBench
T2I-CompBench Score0.4625
27
Detail BindingT2I-CompBench++
BLIP-VQA Color Score87.03
21
Text-to-Image GenerationT2I-CompBench
Color Fidelity83.8
16
Compositional Text-to-Image GenerationT2I-CompBench
Color Accuracy0.7935
16
Text-to-Image GenerationT2I-CompBench
B-VQA Score75
16
Controllable Image Generation (Counting)T2I-CompBench Single Category
Counting MAE1.23
15
Text-to-Image GenerationT2I-CompBench 1.0 (test)
CLIP Score0.344
14
Text-to-Image GenerationT2I-CompBench standard
3D Spatial Score88.61
13
Text-to-Image GenerationT2I-CompBench
Color Fidelity77.07
13
Compositional Text-to-Image GenerationT2I-CompBench v1.0 (test)
Color Score86.92
13
Text-to-image generationT2I-CompBench++ v1.0 (test)
Color Score (B-VQA)73.23
12
Text-to-Image GenerationT2I-CompBench
Evaluation Time (min)5
12
Text-to-Image GenerationT2I-CompBench
Color Score87.23
11
Text-to-Image CompositionalityT2I-CompBench (test)
Color Accuracy78.59
11
Compositional GenerationT2I-CompBench++
Color Score39
10
Text-to-Image GenerationT2I-CompBench
Color Score84.2
10
Text-to-Image GenerationT2I-CompBench
Color Score85.42
9
Text-to-Image GenerationT2I-CompBench
Color Fidelity Score77.68
9
Text-to-ImageT2I-CompBench
Color Fidelity75.68
9
Text-to-Image AlignmentT2I-Compbench
T2I-Compbench Alignment0.5064
9
Showing 25 of 58 rows