Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Arctic-Embed 2.0: Multilingual Retrieval Without Compromise

About

This paper presents the training methodology of Arctic-Embed 2.0, a set of open-source text embedding models built for accurate and efficient multilingual retrieval. While prior works have suffered from degraded English retrieval quality, Arctic-Embed 2.0 delivers competitive retrieval quality on multilingual and English-only benchmarks, and supports Matryoshka Representation Learning (MRL) for efficient embedding storage with significantly lower compressed quality degradation compared to alternatives. We detail the design and implementation, presenting several important open research questions that arose during model development. We conduct experiments exploring these research questions and include extensive discussion aimed at fostering further discussion in this field.

Puxuan Yu, Luke Merrick, Gaurav Nuti, Daniel Campos• 2024

Related benchmarks

TaskDatasetResultRank
Information RetrievalBEIR (test)--
126
Information RetrievalBEIR--
120
Text EmbeddingMTEB English v2
Mean Score63.6
107
Text ClassificationN24News (test)
Macro F157.21
52
Multilingual RetrievalMTEB Multilingual v2
nDCG@1054.8
40
RetrievalMTEB eng v2
nDCG@1058.4
31
Multilingual Text EmbeddingMTEB Multilingual
Mean Score (Task)57
29
Multilingual Long-context RetrievalMLDR
nDCG@1034
28
Information RetrievalLongEmbed
NDCG@1055.4
26
Code RetrievalMTEB Code
nDCG@1055.2
21
Showing 10 of 31 rows

Other info

Follow for update