Cross-Preference Learning for Sentence-Level and Context-Aware Machine Translation
About
Context-aware machine translation (MT) leverages document-level information, yet it does not consistently outperform sentence-level MT, as contextual signals are unevenly beneficial across sentences. Existing training objectives do not explicitly model this variability, limiting a model's ability to adaptively exploit context. In this paper, we propose Cross-Preference Learning (CPL), a preference-based training framework that explicitly captures the complementary benefits of sentence-level and context-aware MT. CPL achieves this by integrating both intra- and cross-condition preferences into the preference optimization objective. The introduction of intra- and cross-condition preferences provides explicit supervision on when and how contextual information improves translation quality. We validate the proposed approach on several public context-aware MT tasks using multiple models, including Qwen3-4B, Qwen3-8B, and Llama-3-8B. Experimental results demonstrate consistent improvements in translation quality and robustness across both input conditions, achieved without any architectural modifications.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Machine Translation | En-Es document-level | d-COMET86.05 | 66 | |
| Machine Translation | EN-DE | COMET84.69 | 51 | |
| Machine Translation | English-to-German en-de | BLEU Score34.17 | 48 | |
| Machine Translation | En-Es | BLEU42.03 | 26 | |
| Machine Translation | WMT News Commentary and IWSLT (En-De) 25 | COMET Score87.23 | 21 | |
| Machine Translation | En-Ru document-level | d-COMET84.36 | 21 | |
| Machine Translation | WMT News Commentary and IWSLT (En-Es) 25 | COMET Score88.51 | 7 | |
| Machine Translation | WMT News Commentary and IWSLT En-Fr 25 | COMET Score86.65 | 7 | |
| Machine Translation | WMT News Commentary and IWSLT (En-It) 25 | COMET Score89.99 | 7 | |
| Machine Translation | WMT News Commentary and IWSLT En-Nl 25 | COMET Score89 | 7 |