Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

jina-embeddings-v4: Universal Embeddings for Multimodal Multilingual Retrieval

About

We introduce jina-embeddings-v4, a 3.8 billion parameter multimodal embedding model that unifies text and image representations through a novel architecture supporting both single-vector and multi-vector embeddings in the late interaction style. The model incorporates task-specific Low-Rank Adaptation (LoRA) adapters to optimize performance across diverse retrieval scenarios, including query-document retrieval, semantic text similarity, and code search. Comprehensive evaluations demonstrate that jina-embeddings-v4 achieves state-of-the-art performance on both single-modal and cross-modal retrieval tasks, with particular strength in processing visually rich content such as tables, charts, diagrams, and mixed-media formats. To facilitate evaluation of this capability, we also introduce Jina-VDR, a novel benchmark specifically designed for visually rich image retrieval.

Michael G\"unther, Saba Sturua, Mohammad Kalim Akram, Isabelle Mohr, Andrei Ungureanu, Bo Wang, Sedigheh Eslami, Scott Martens, Maximilian Werk, Nan Wang, Han Xiao• 2025

Related benchmarks

TaskDatasetResultRank
Text EmbeddingMTEB English v2
Mean Score65.09
68
Information RetrievalBEIR--
62
Visual document retrievalViDoRe V2--
36
Multilingual Text EmbeddingMTEB Multilingual
Mean Score (Task)58.17
29
Multilingual RetrievalMTEB Multilingual v2
nDCG@1066.4
28
Visual document retrievalViDoRe V3
HR59.53
23
RetrievalMTEB eng v2
nDCG@1056.2
19
RetrievalMTEB-E English v2
MTEB-E Retrieval Score56.15
16
RetrievalRTEB Multilingual Public
RTEB66.52
11
RetrievalLongEmbed
Long Task Score69.88
11
Showing 10 of 12 rows

Other info

Follow for update