ADaPT: Token-Level Decoupling for Efficient Large Reasoning Models
About
Large reasoning models rely on long chain-of-thought to achieve strong performance, but applying such reasoning uniformly incurs high computational cost. Existing efficiency-oriented methods attempt to shorten or mix reasoning strategies, yet often degrade reasoning capability. We identify the root cause as sequence-level coupling between efficiency incentives and correctness optimization, which implicitly penalizes long but correct reasoning trajectories. To address this issue, we propose Adaptive Dual-Process Thinking (ADaPT), a token-level dual-process framework that explicitly decouples efficiency and correctness signals during training. ADaPT introduces a mode-selection token to control fast and slow reasoning, applying efficiency-related rewards exclusively to this token to avoid penalizing correct long reasoning while encouraging efficiency when appropriate. Moreover, ADaPT enables precise and continuous control over the efficiency-performance trade-off at inference time: by adjusting the generation probability of the mode-selection token, a single trained model can smoothly move along the efficiency-performance Pareto frontier. Extensive experiments demonstrate that ADaPT significantly reduces inference cost while maintaining strong reasoning performance across multiple benchmarks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Reasoning | ARC | Accuracy87.7 | 269 | |
| Mathematical Reasoning | MATH500 | Accuracy78.2 | 104 | |
| Mathematical Reasoning | Olympiad | Pass@1 Accuracy40.2 | 60 | |
| Question Answering | CSQA | Accuracy (CSQA)86.7 | 24 | |
| General Reasoning | Aggregate Easy and Hard Benchmarks | Accuracy63.7 | 18 | |
| Massive Multitask Language Understanding | MMLU-Pro | Accuracy49.8 | 18 | |
| Math Word Problems | GSM8K | Accuracy91.4 | 18 | |
| Mathematical Reasoning | AIME 2024 | Accuracy (ACC)15.1 | 18 |