Share your thoughts, 1 month free Claude Pro on usSee more

Multilingual Information Retrieval on Belebele

0.926nDCG@20

embeddinggemma-300m + SHIFT

Updated 1mo ago

Evaluation Results

Method
embeddinggemma-300m + SHIFT 2026.06	0.926	92.8
embeddinggemma-300m 2026.06	0.924	92.6
gte-Qwen2-1.5B-instruct + SHIFT 2026.06	0.914	91.2
multilingual-e5-large + SHIFT 2026.06	0.91	90.7
gte-Qwen2-1.5B-instruct 2026.06	0.904	90.1
Qwen3-Embedding-0.6B + SHIFT 2026.06	0.895	89.2
Qwen3-Embedding-0.6B 2026.06	0.89	88.7
bge-m3 + SHIFT 2026.06	0.876	87.4
bge-m3 2026.06	0.874	87.1
multilingual-e5-large 2026.06	0.816	81.2
llama-nemotron-embed-1b-v2 + SHIFT 2026.06	0.7	69.7
llama-nemotron-embed-1b-v2 2026.06	0.688	68.1
LangSAE Editing 2026.01	0.6653	67.4
jina-embeddings-v3 2026.01	0.6649	67.39
SAE Reconstructed 2026.01	0.6624	66.9
LangSAE Editing 2026.01	0.652	65.68
jina-embeddings-v3 2026.01	0.6488	65.29
SAE Reconstructed 2026.01	0.6471	65.1
LangSAE Editing 2026.01	0.6333	63.88
jina-embeddings-v3 2026.01	0.6318	63.88
SAE Reconstructed 2026.01	0.6304	63.54
LangSAE Editing 2026.01	0.6134	61.86
jina-embeddings-v3 2026.01	0.6112	61.86
SAE Reconstructed 2026.01	0.6108	61.59
LangSAE Editing 2026.01	0.5839	58.73
SAE Reconstructed 2026.01	0.5836	58.74
LangSAE Editing 2026.01	0.5809	58.28
jina-embeddings-v3 2026.01	0.5806	58.76
jina-embeddings-v3 2026.01	0.5786	57.57
SAE Reconstructed 2026.01	0.5767	57.68
LangSAE Editing 2026.01	0.5648	56.17
SAE Reconstructed 2026.01	0.5611	55.38
jina-embeddings-v3 2026.01	0.5529	54.3
jina-embeddings-v3 2026.01	0.5504	55.74
LangSAE Editing 2026.01	0.5474	55.86
SAE Reconstructed 2026.01	0.545	55.3
LangSAE Editing 2026.01	0.5432	54.23
SAE Reconstructed 2026.01	0.5405	53.86
jina-embeddings-v3 2026.01	0.5401	53.9
LangSAE Editing 2026.01	0.3802	36.83
SAE Reconstructed 2026.01	0.3782	36.66
jina-embeddings-v3 2026.01	0.3752	36.56
LangSAE Editing 2026.01	0.2111	17.74
SAE Reconstructed 2026.01	0.2103	17.69
jina-embeddings-v3 2026.01	0.2071	17.6