Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multimodal Retrieval on MMEB Total v2
Loading...
68.1
Overall Score
UME-R1
39.292
46.771
54.25
61.729
Nov 1, 2025
Overall Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
Overall Score
UME-R1
Backbone=Qwen2-VL, Par...
2025.11
68.1
UME-R1
Backbone=Qwen2-VL, Par...
2025.11
64.5
UME-R1
Backbone=Qwen2-VL, Par...
2025.11
64.4
CAFe
Backbone=LLaVA-OV, Par...
2025.11
60.6
UME-R1
Backbone=Qwen2-VL, Par...
2025.11
60.1
VLM2Vec-V2
Backbone=Qwen2-VL, Par...
2025.11
58
GME
Backbone=Qwen2-VL, Par...
2025.11
57.8
DUME
Backbone=Qwen2-VL, Par...
2025.11
55.9
GME
Backbone=Qwen2-VL, Par...
2025.11
54.1
DUME
Backbone=Qwen2-VL, Par...
2025.11
52.7
VLM2Vec
Backbone=Qwen2-VL, Par...
2025.11
52.3
LamRA
Backbone=Qwen2.5-VL, P...
2025.11
47.4
VLM2Vec
Backbone=Qwen2-VL, Par...
2025.11
47
ColPali-V1.3
Backbone=PaliGemma, Pa...
2025.11
44.4
LamRA
Backbone=Qwen2-VL, Par...
2025.11
40.4
Feedback
Search any
task
Search any
task