From "Aha Moments" to Controllable Thinking: Toward Meta-Cognitive Reasoning in Large Reasoning Models via Decoupled Reasoning and Control
About
Large Reasoning Models (LRMs) can exhibit step-by-step reasoning, reflection, and backtracking, but these behaviors are often unregulated, leading to overthinking. As a result, LRMs continue generating redundant reasoning even after reaching high-confidence conclusions. This increases inference cost and latency, limiting practical deployment. The root cause is the absence of an intrinsic mechanism to monitor the reasoning state and decide when to continue, backtrack, or stop. We propose MERA, a meta-cognitive reasoning framework that decouples reasoning from control to enable independent optimization of control strategies. MERA constructs high-quality reasoning-control supervision data via a takeover-based pipeline, and transforms long-horizon traces into structured reasoning-control alternating sequences for training. The model is trained with supervised fine-tuning to internalize the structured separation, and further optimized with Control-Segment Policy Optimization (CSPO), which combines segment-wise GRPO with control masking to focus learning on control segments. Experiments across reasoning benchmarks show that MERA improves both efficiency and accuracy.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Mathematical Reasoning | AIME 2024 | Accuracy63.3 | 394 | |
| Mathematical Reasoning | GSM8K | Accuracy96.1 | 166 | |
| Mathematical Reasoning | AMC 2023 | Accuracy88 | 104 | |
| Mathematical Reasoning | MATH 500 | Average Tokens2.24e+3 | 104 | |
| Mathematical Reasoning | AIME 2025 | Accuracy59.2 | 24 | |
| Mathematical Reasoning | Overall GSM8K, MATH-500, AMC 2023, AIME 2024, AIME 2025 | Accuracy79.8 | 24 | |
| Question Answering | MMLU-Pro | Law Accuracy25.7 | 5 |