Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Multilingual Reasoning Cascades Need More Context

About

Translation cascades for reasoning translate the query from another language to English, reason in English, and translate the answer back to the original language. This is a competitive approach to multilingual reasoning, but structurally lossy, since each stage discards information later stages may need, including cues for cultural grounding, register, and disambiguation. We examine the benefits of a simple and training-free intervention: a context-aware translation cascade, which additionally provides the original question, the English translated question, and the reasoning trace to the context of the final translation module. We evaluate gains across nine multilingual benchmarks including various task types, three backbone models, and 285 high-, mid-, and low-resource languages, and demonstrate strong gains for open-ended generation across models and resource regimes. We show that the original language question carries most of the beneficial context. Our study emphasizes the need to better design information flow in machine translation cascades for mitigating error propagation, and provides a simple and actionable default strategy: preserve the original user question until the end of the pipeline.

Arnav Mazumder, Dengjia Zhang, Shuyue Stella Li, Yulia Tsvetkov, Niyati Bafna• 2026

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningMGSM
Accuracy91.52
245
Open-ended culturalGlobal-PIQA OE
chrF18.73
9
Open-ended factualMKQA
chrF27.92
9
Commonsense MCQGlobal-PIQA
Accuracy76.95
9
Knowledge MCQGlobal MMLU
Accuracy69.84
9
Knowledge MCQBelebele
Accuracy58.24
9
MathMMATH
Accuracy (MMath)38.33
9
Open-ended culturalAya
chrF15.52
9
Commonsense MCQmCSQA
Accuracy67.92
9
Open-ended culturalBLEND
chrF17.26
9
Showing 10 of 10 rows

Other info

Follow for update