Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

From "Aha Moments" to Controllable Thinking: Toward Meta-Cognitive Reasoning in Large Reasoning Models via Decoupled Reasoning and Control

About

Large Reasoning Models (LRMs) can exhibit step-by-step reasoning, reflection, and backtracking, but these behaviors are often unregulated, leading to overthinking. As a result, LRMs continue generating redundant reasoning even after reaching high-confidence conclusions. This increases inference cost and latency, limiting practical deployment. The root cause is the absence of an intrinsic mechanism to monitor the reasoning state and decide when to continue, backtrack, or stop. We propose MERA, a meta-cognitive reasoning framework that decouples reasoning from control to enable independent optimization of control strategies. MERA constructs high-quality reasoning-control supervision data via a takeover-based pipeline, and transforms long-horizon traces into structured reasoning-control alternating sequences for training. The model is trained with supervised fine-tuning to internalize the structured separation, and further optimized with Control-Segment Policy Optimization (CSPO), which combines segment-wise GRPO with control masking to focus learning on control segments. Experiments across reasoning benchmarks show that MERA improves both efficiency and accuracy.

Rui Ha, Rui Pu, Chaozhuo Li, Li Sun, Sen Su• 2025

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningAIME 2024
Accuracy63.3
394
Mathematical ReasoningGSM8K
Accuracy96.1
166
Mathematical ReasoningAMC 2023
Accuracy88
104
Mathematical ReasoningMATH 500
Average Tokens2.24e+3
104
Mathematical ReasoningAIME 2025
Accuracy59.2
24
Mathematical ReasoningOverall GSM8K, MATH-500, AMC 2023, AIME 2024, AIME 2025
Accuracy79.8
24
Question AnsweringMMLU-Pro
Law Accuracy25.7
5
Showing 7 of 7 rows

Other info

Follow for update