Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Retrieval on MMEB Image V2

78.2Overall Score

Qwen3-VL-Reranker-8B

Updated 1mo ago

Evaluation Results

Method	Links
Qwen3-VL-Reranker-8B 2026.06		78.2	-	-	-	-
Qwen3-VL-8B-reranker 2026.06		76.2	70	77.8	75.2	90.8
Qwen3-VL-4B-reranker 2026.06		75.4	69.7	76.1	75.2	88.7
Qwen3-VL-8B-miniReranker 2026.06		74.3	69.2	73.9	73.7	89.7
UME-R1 2025.11		74.2	69.1	73.2	74.8	87.4
Qwen3-VL-Reranker-2B 2026.06		74	-	-	-	-
Qwen3-VL-4B-miniReranker 2026.06		72.5	68.3	71.5	73.5	81.8
Qwen3-VL-2B-reranker 2026.06		71.6	67.1	71.8	71.8	82.2
UME-R1 2025.11		71.3	67.1	69.2	71.9	84.9
UME-R1 2025.11		70.2	67.6	67.5	71.2	80.1
Qwen3-VL-2B-miniReranker 2026.06		68.2	65.6	65.7	69.7	76.5
CAFe 2025.11		67.6	63.6	61.7	69.1	87.6
UME-R1 2025.11		66.6	64.8	62.8	67.6	77.2
UME-R1 2026.04		66.6	64.8	62.8	67.6	77.2
DUME 2025.11		66.4	64.2	57	70.8	81.8
PLUME 2026.04		66.3	66.5	59.2	67.6	79.7
VLM2Vec 2025.11		65.5	62.7	56.9	69.4	82.2
VLM2Vec-Qwen2VL (7B) 2026.06		65.5	62.7	56.9	69.4	82.2
VLM2Vec-V2 2025.11		64.9	62.9	56.3	69.5	77.3
VLM2Vec-V2 2026.04		64.9	62	56.3	69.5	77.3
DUME 2025.11		62.5	59.3	55	66.3	78
DUME 2026.04		62.5	59.3	55	66.3	78
Qwen3-VL-2B-Instruct 2026.06		61.7	59.2	61.2	60.1	74.2
VLM2Vec 2025.11		59.7	58.7	49.3	65	72.9
VLM2Vec 2026.04		59.7	58.7	49.3	65	72.9
VLM2Vec (2B) 2026.06		59.7	58.7	49.3	65	72.9
GME 2025.11		56	57.7	34.7	71.2	59.3
GME (7B) 2026.06		56	57.7	34.7	71.2	59.3
LamRA 2025.11		54.1	59.2	26.5	70	62.7
LamRA 2026.04		54.1	59.2	26.5	70	62.7
LamRA 2025.11		52.4	51.7	34.1	66.9	56.7
LamRA-Qwen2.5 (7B) 2026.06		52.4	51.7	34.1	66.9	56.7
GME 2025.11		51.9	54.4	29.9	66.9	55.5
GME 2026.04		51.9	54.4	29.9	66.9	55.5
GME (2B) 2026.06		51.9	54.4	29.9	66.9	55.5
ColPali-V1.3 2025.11		34.9	40.3	11.5	48.1	40.3
ColPali v1.3 (3B) 2026.06		34.9	40.3	11.5	48.1	40.3