Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Efficient Multilingual Reasoning Transfer via Progressive Code-Switching

About

Large reasoning models (LRMs) have achieved strong reasoning capabilities in English, yet their performance degrades significantly when required to reason in other languages. A natural solution is to transfer the model's English reasoning ability to target languages. However, existing transfer approaches typically rely on distilled target-language reasoning traces from stronger LRMs or online supervision from external judge models, which are costly and difficult to scale. In this paper, we propose PCS (Progressive Code-Switching), a more efficient transfer framework that requires only lightweight translation without any stronger model for distillation or judging. PCS first constructs code-switched reasoning traces by translating a subset of English reasoning steps into the target language, and uses them to initialize the model's code-switching ability via supervised fine-tuning. It then applies reinforcement learning with a step-level language consistency curriculum, progressively raising the target-language ratio until the model reasons entirely in the target language. This progressive design provides a smooth transfer path that avoids the instability and performance degradation commonly observed when directly enforcing target-language reasoning. Experiments on multiple benchmarks and five typologically diverse languages show that PCS substantially narrows the performance gap between target-language and English reasoning, yielding more language-consistent reasoning while maintaining competitive accuracy.

Zhijun Wang, Junxiao Liu, Hao Zhou, Hao-Ran Wei, Baosong Yang, Shujian Huang• 2026

Related benchmarks

TaskDatasetResultRank
Math ReasoningMMATH
FR SLC & Acc35.1
8
Math ReasoningMMLU Pro Xmath
FR slc&acc75.1
8
Multilingual Mathematical ReasoningMMATH
FR Accuracy and SLC41.2
8
Multilingual Mathematical ReasoningMMLU Pro Xmath
FR SLC&Acc79.9
8
Showing 4 of 4 rows

Other info

Follow for update