Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Compositional Reasoning on SugarCrepe++
Loading...
79.7
Replace I2T
C^2LIP
74.084
75.542
77
78.458
Mar 26, 2026
Replace I2T
Replace TOT
Swap I2T
Swap TOT
Average Performance
Updated 22d ago
Evaluation Results
Method
Method
Links
Replace I2T
Replace TOT
Swap I2T
Swap TOT
Average Performance
C^2LIP
Backbone=ViT-B/16
2026.03
79.7
75.3
55.2
44.2
75
SigLIP2-ViT-B/16
Backbone=ViT-B/16
2026.03
77.7
69.7
57.9
42
74.4
BLIP-B
Backbone=ViT-B
2026.03
76.7
86
52.1
41.3
71.3
CLIPS (ViT-L/14)
Backbone=ViT-L/14
2026.03
76.6
66.6
59.4
44.3
75.2
SigLIP ViT-L/16-res256
Backbone=ViT-L/16, Inp...
2026.03
75.4
64.9
55.6
42.1
73.4
CLIP-A (ViT-L/14)
Backbone=ViT-L/14
2026.03
74.7
74.8
45.8
30.8
70.5
FLAVA
Backbone=ViT-B
2026.03
74.3
75
56.6
51
69.9
Feedback
Search any
task
Search any
task