Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Retrieval and Understanding on MMEB V2 (test)

76.7Image CLS Acc

IFM-TTE

Updated 4d ago

Evaluation Results

Method
IFM-TTE 2026.01	76.7	78.5	74.6	89.3	77.9	60.5	67.9	51.7	54.9	59.2	85.2	71.5	92.7	53.3	79.5	74.1
IFM-TTE 2026.04	76.7	78.5	74.6	89.3	77.9	60.5	67.9	51.7	54.9	59.2	85.2	71.5	92.8	33.7	76.2	73.1
Seed-1.6-embedding-0615 2026.01	76.1	74	77.9	91.3	77.8	55	60.8	51.3	53.5	55.3	85.3	56.6	84.7	68.6	77.7	72.6
Seed-1.6-embedding-1215 2026.01	75	74.9	79.3	89	78	85.2	66.7	59.1	54.8	67.7	90	60.3	90	70.7	82.2	76.9
Qwen3-VL-Embedding-8B 2026.01	74.2	81.1	80.2	92.3	80.1	78.4	71	58.7	56.1	67.1	87.2	69.9	88.7	73.3	82.4	77.8
RzenEmbed 2026.01	70.6	71.7	78.5	92.1	75.9	58.8	63.5	51	45.5	55.7	89.7	60.7	88.7	69.9	81.3	72.9
RzenEmbed-V2 2026.04	70.6	71.7	78.5	92.1	75.9	58.8	63.5	51	45.5	55.7	89.7	60.7	88.7	44.4	77.1	71.6
Qwen3-VL-Embedding-2B 2026.01	70.3	74.3	74.8	88.5	75	71.9	64.9	53.9	53.3	61.9	84.4	65.3	86.4	69.4	79.2	73.2
Ops-MM-embedding-v1 2026.01	69.7	69.6	73.1	87.2	72.7	59.7	62.2	45.7	43.2	53.8	80.1	59.6	79.3	67.8	74.4	68.9
RzenEmbed 2026.01	68.5	66.3	74.5	90.3	72.3	50.4	49.7	46.6	38.9	47.3	87.1	55.1	87.2	43.4	74.5	67.2
Ops-MM-embedding-v1 2026.01	68.1	65.1	69.2	80.9	69	53.6	55.6	41.8	33.7	47.6	76.4	53.2	77.6	64.2	70.8	64.6
UME-R1 2026.04	67.1	69.2	71.9	84.9	71.3	48.6	60.7	38.2	39.3	47.5	75.7	50.5	83.7	29.2	65.7	64.1
UniME-V2 2026.04	65.6	68.7	73.1	90.9	71.8	37.2	50.6	28.9	39.6	39	61.8	42	70.5	37.9	56.7	59.6
RzenEmbed-V1 2026.04	65.3	61.7	73.8	77.9	68.5	45.6	47.5	38.3	36.7	42.6	87	57.6	85.4	43.3	74.4	64.4
CAFe 2026.04	65.2	65.6	70	91.2	67.6	35.8	58.7	34.4	39.5	42.4	70.7	49.6	79.5	38.1	63.9	60.6
VLM2Vec-V2 2026.04	64.5	56.2	67.2	74.7	64.2	39.1	34.4	28.2	32	33.6	66	37.1	77.6	32.4	58.5	55.4
BToks 2026.04	64.3	59.8	68.8	77.4	66	43.7	47	33	33.6	39.9	71.1	38.6	81.3	38.1	62.7	59
VLM2Vec-V2 2026.01	62.9	56.3	69.5	77.3	64.9	39.3	34.3	28.8	36.8	34.6	75.5	44.9	79.4	62.2	69.2	59.2
VLM2Vec 2026.01	62.7	56.9	69.4	82.2	65.5	39.1	30	29	38.9	33.7	56.9	9.4	59.1	54	49.1	53.1
VLM2Vec 2026.01	58.7	49.3	65	72.9	59.7	33.4	30.5	20.6	30.7	28.6	49.8	13.5	51.8	48.2	44	47.7
VLM2Vec-V1 2026.04	58.7	49.3	65	72.9	59.7	33.4	30.5	20.6	30.8	28.6	49.8	13.5	51.8	33.6	41.6	47
GME 2026.01	57.7	34.7	71.2	59.3	56	37.4	50.4	28.4	37	38.4	89.4	55.6	85	68.3	79.3	59.1
Gme 2026.04	57.7	34.7	71.2	59.3	56	37.4	50.4	28.4	37	38.4	89.4	55.6	85	44.4	75.2	57.8
Gme 2026.04	56.9	41.2	67.8	53.4	51.9	34.9	42	25.6	31.1	33.6	86.2	54	82.5	43.1	72.7	54.1
GME 2026.01	54.4	29.9	66.9	55.5	51.9	34.9	42	25.6	31.1	33.6	86.1	54	82.5	67.5	76.8	55.3
LamRA 2026.04	51.7	34.1	66.9	56.7	52.4	32.9	42.6	23.2	37.2	33.6	56.3	33.3	58.2	40.1	50.2	47.4
ColPali 2026.04	40.3	11.5	48.1	40.3	34.9	26.7	37.8	21.6	25.5	28.2	83.6	52	81.1	43.1	71	44.4