Our new X account is live! Follow @wizwand_team for updates

Multi-lingual retrieval on MIRACL (dev)

71.5Avg Score

M3-Embedding

Updated 4d ago

Evaluation Results

Method	Links
M3-Embedding 2024.02		71.5	80.2	81.5	59.6	59.7	63.4	80.4	61.2	63.3	59	75.2	72.1	71.7	79.6	88.1	83.7	64.9	59.8	83.5	-
M3-Embedding 2024.02		70.5	79.6	81	59.3	57.8	62	80.1	59.4	61.5	58.3	74.5	71.2	71.2	79.1	87.9	83	63.7	58	82.4	-
M3-Embedding 2024.02		70.4	79.6	80.7	58.8	58.1	62.3	79.7	58	62.9	58.3	73.9	71.2	69.8	78.5	87.2	83.1	63.5	57.7	83.3	-
M3-Embedding 2024.02		69.2	78.4	80	56.9	56.1	60.9	78.6	58.3	59.5	56.1	72.8	69.9	70.1	78.7	86.2	82.6	62.7	56.7	81.8	-
mE5large 2024.02		66.6	76	75.9	52.9	52.9	59	77.8	54.5	62	52.9	70.6	66.5	67.4	74.9	84.6	80.2	56	56.4	78.3	-
E5mistral-7b 2024.02		63.4	73.3	70.3	57.3	52.2	52.1	74.7	55.2	52.1	52.7	66.8	61.8	67.7	68.4	73.9	74	54	54.1	79.7	-
OpenAI-3 2024.02		54.9	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
M3-Embedding 2024.02		53.9	67.1	68.9	43.8	38.6	45.1	65.4	35.3	48.2	48.9	56.1	61.5	44.5	57.9	79.1	70.9	36.1	32.5	70	-
mContriever 2024.02		43.1	52.5	50.1	36.4	41.8	21.5	60.2	31.4	28.6	39.2	42.4	48.3	39.1	56	52.8	51.7	41	40.8	41.5	-
mDPR 2024.02		41.8	49.9	44.3	39.4	47.8	48	47.2	43.5	38.3	27.2	43.9	41.9	40.7	29.9	35.6	35.8	51.2	49	39.6	-
BM25 2024.02		31.9	39.5	48.2	26.7	7.7	28.7	45.8	11.5	35	29.7	31.2	37.1	25.6	35.1	38.3	49.1	17.5	12	56.1	-
CLS 2026.01		-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	57.6
Mean 2026.01		-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	56.1
Latent 2026.01		-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	56.6
LMK 2026.01		-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	58
LMK 2026.01		-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	57.8
LMK 2026.01		-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	57.9
LMK 2026.01		-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	57.9
LMK 2026.01		-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	57.7