Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Cross-Preference Learning for Sentence-Level and Context-Aware Machine Translation

About

Context-aware machine translation (MT) leverages document-level information, yet it does not consistently outperform sentence-level MT, as contextual signals are unevenly beneficial across sentences. Existing training objectives do not explicitly model this variability, limiting a model's ability to adaptively exploit context. In this paper, we propose Cross-Preference Learning (CPL), a preference-based training framework that explicitly captures the complementary benefits of sentence-level and context-aware MT. CPL achieves this by integrating both intra- and cross-condition preferences into the preference optimization objective. The introduction of intra- and cross-condition preferences provides explicit supervision on when and how contextual information improves translation quality. We validate the proposed approach on several public context-aware MT tasks using multiple models, including Qwen3-4B, Qwen3-8B, and Llama-3-8B. Experimental results demonstrate consistent improvements in translation quality and robustness across both input conditions, achieved without any architectural modifications.

Ying Li, Xinglin Lyu, Junhui Li, Jinlong Yang, Hengchao Shang, Min Zhang, Shimin Tao, Daimeng Wei• 2026

Related benchmarks

TaskDatasetResultRank
Machine TranslationEn-Es document-level
d-COMET86.05
66
Machine TranslationEN-DE
COMET84.69
51
Machine TranslationEnglish-to-German en-de
BLEU Score34.17
48
Machine TranslationEn-Es
BLEU42.03
26
Machine TranslationWMT News Commentary and IWSLT (En-De) 25
COMET Score87.23
21
Machine TranslationEn-Ru document-level
d-COMET84.36
21
Machine TranslationWMT News Commentary and IWSLT (En-Es) 25
COMET Score88.51
7
Machine TranslationWMT News Commentary and IWSLT En-Fr 25
COMET Score86.65
7
Machine TranslationWMT News Commentary and IWSLT (En-It) 25
COMET Score89.99
7
Machine TranslationWMT News Commentary and IWSLT En-Nl 25
COMET Score89
7
Showing 10 of 15 rows

Other info

Follow for update