Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DyCon: Dynamic Reasoning Control via Evolving Difficulty Modeling

About

Recent advances in Large Reasoning Models (LRMs) demonstrate remarkable performance improvements by iteratively reflecting, exploring, and executing complex tasks, yet suffer from inefficiencies due to redundant reasoning, known as "overthinking". Existing methods to mitigate this issue either rely on static difficulty estimates or require task-specific training, and thus fail to adapt to the dynamic complexity during reasoning. In this work, we empirically show that the problem difficulty evolves dynamically throughout the reasoning process and is linearly encoded in the LRM's step-level embeddings. Building on this insight, we propose DyCon, a training-free framework that leverages latent step-level representations to explicitly model the evolving task difficulty, enabling the dynamic control of reasoning depth to mitigate the overthinking issue. Extensive experiments conducted on four models ranging from 4B to 32B, and across twelve benchmarks in math reasoning, general question answering, and coding tasks demonstrate that DyCon significantly enhances reasoning efficiency by reducing redundant steps without sacrificing accuracy or generalization. Code is available at https://github.com/yu-lin-li/DyCon.

Tengyao Tu, Yulin Li, Hui-Ling Zhen, Libo Qin, Zhoujun Wei, Jinghua Piao, Zhuotao Tian, Yong Li, Min Zhang• 2026

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningGSM8K
Accuracy96.8
166
Mathematical ReasoningMATH 500
Average Tokens6.09e+3
104
Mathematical ReasoningAMC 23
Pass@1 Accuracy100
71
Mathematical ReasoningAIME 24
Pass@1 Accuracy86.7
34
Mathematical ReasoningAIME 25
Pass@1 Accuracy76.7
33
Mathematical ReasoningMMLU algebra
Pass@197
31
Mathematical ReasoningMATH 500
Pass@1 Accuracy86.6
19
Code ReasoningLiveCodeBench
Pass@192
8
Commonsense ReasoningCommonsenseQA
Pass@1 Accuracy85.5
8
Implicit ReasoningStrategyQA
Pass@196
8
Showing 10 of 22 rows

Other info

Follow for update