Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multicultural Visual Reasoning on MaRVL translated English version (test)
Loading...
73.47
Accuracy
METER
66.2524
68.1262
70
71.8738
Jan 5, 2023
Accuracy
Performance Delta
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
Performance Delta
METER
Data/Steps=4M/-, #Para...
2023.01
73.47
8.86
ALBEF
Data/Steps=14M/-, #Par...
2023.01
73.17
9.37
X-VLM
Data/Steps=16M/-, #Par...
2023.01
73.02
11.39
GIVL
Data/Steps=3.17M/900K,...
2023.01
72.7
7.17
GIVL
Data/Steps=3.17M/500K,...
2023.01
72.5
6.56
VinVL
Data/Steps=5.65M/2M, #...
2023.01
72.48
8.55
GIVL w/o LIKM
Data/Steps=3.17M/500K,...
2023.01
72.11
-
GIVL w/ CLIP
Data/Steps=3.17M/500K,...
2023.01
71.78
-
GIVL-B
Data/Steps=3.17M/500K,...
2023.01
70.26
-
VinVL*
Data/Steps=3.17M/500K,...
2023.01
69.66
8.27
GIVL w/o LIEC
Data/Steps=3.17M/500K,...
2023.01
68.58
-
ViLBERT
Data/Steps=3.3M/-, #Pa...
2023.01
66.53
10.87
Feedback
Search any
task
Search any
task