Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

T2I-CompBench

Benchmarks

Task NameDataset NameSOTA ResultTrend
Text-to-Image GenerationT2I-CompBench
Shape Fidelity73.66
185
Text-to-Image GenerationT2I-CompBench (test)
Color Accuracy91
86
Text-to-Image GenerationT2I-CompBench++
Non-Spatial31.97
65
Text-to-Image GenerationT2I-CompBench
Color Fidelity84.47
46
Text-to-Image Compositional AlignmentT2I-CompBench++ v2 (test)
Color86.97
37
Text-to-Image GenerationT2I-CompBench
T2I-CompBench Score0.4625
27
Text-to-Image GenerationT2I-CompBench
B-VQA Score75
16
Controllable Image Generation (Counting)T2I-CompBench Single Category
Counting MAE1.23
15
Text-to-Image GenerationT2I-CompBench 1.0 (test)
CLIP Score0.344
14
Compositional Text-to-Image GenerationT2I-CompBench v1.0 (test)
Color Score86.92
13
Text-to-Image GenerationT2I-CompBench
Evaluation Time (min)5
12
Text-to-Image CompositionalityT2I-CompBench (test)
Color Accuracy78.59
11
Text-to-ImageT2I-CompBench
Color Fidelity75.68
9
Text-to-Image AlignmentT2I-Compbench
T2I-Compbench Alignment0.5064
9
Text-to-Image GenerationT2I-CompBench
DINO Score0.799
9
Text-to-Image GenerationT2I-CompBench color set
2 Objects Exist76.3
9
Text-to-Image GenerationT2I-CompBench
Color Fidelity84.11
8
Text-to-Image GenerationT2I-CompBench out-of-domain
Semantic Consistency51.37
7
Text-to-image GenerationT2I-Compbench Count
Human Accuracy48
7
Text-to-image generationT2I-CompBench
B-VQA75
6
Text-to-image generationT2I-CompBench
ImageReward0.9377
6
Image-Text AlignmentT2I-CompBench (val)
Image Alignment Reward20.912
4
Aesthetic PreferenceT2I-CompBench (val)
Aesthetic Reward7.7061
4
Text-to-Image GenerationT2I-CompBench
2D Spatial Score48
4
Text-to-Image GenerationT2I-CompBench Color ++
M-LPIPS0.621
3
Showing 25 of 27 rows