Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Fine-grained Retrieval on Winoground (test)
Loading...
40
Text Agreement (%)
Sugar
14.52
21.135
27.75
34.365
Nov 1, 2024
Text Agreement (%)
Image Agreement (%)
Group Agreement (%)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Text Agreement (%)
Image Agreement (%)
Group Agreement (%)
Sugar
2024.11
40
36.3
27
UNITER
Size=large
2024.11
38
14
10.5
VinVL
2024.11
37.8
17.8
14.5
VILLA
Size=large
2024.11
37
13.25
10
BLIP
2024.11
34.8
14
9.3
FLAVA
Objective=ITM
2024.11
32.3
20.5
14.3
CLIP
Backbone=ViT-B/32
2024.11
30.8
10.5
8
FLAVA
Objective=contrastive
2024.11
25.3
13.5
9
LXMERT
2024.11
23.8
7.3
4.8
ViLBERT
Size=base
2024.11
23.8
7.3
4.8
ViLT
Backbone=ViT-B/32
2024.11
19.3
7
4
VisualBERT
Size=base
2024.11
15.5
2.5
1.5
Feedback
Search any
task
Search any
task
