Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Think When You Need: Self-Adaptive Chain-of-Thought Learning

About

Chain of Thought (CoT) reasoning enhances language models' performance but often leads to inefficient "overthinking" on simple problems. We identify that existing approaches directly penalizing reasoning length fail to account for varying problem complexity. Our approach constructs rewards through length and quality comparisons, guided by theoretical assumptions that jointly enhance solution correctness with conciseness. Moreover, we further demonstrate our method to fuzzy tasks where ground truth is unavailable. Experiments across multiple reasoning benchmarks demonstrate that our method maintains accuracy while generating significantly more concise explanations, effectively teaching models to "think when needed."

Junjie Yang, Ke Lin, Xing Yu• 2025

Related benchmarks

TaskDatasetResultRank
Long-context ReasoningLongBench v2--
48
Mathematical ReasoningAIME 25
AUCOAA79.6
11
Code GenerationLiveCodeBench
AUCOAA93.9
11
Mathematical ReasoningMATH 500
AUCOAA89.6
11
Mathematical ReasoningAIME 24
AUCOAA74.5
11
Commonsense ReasoningCommon sense QA
AUCOAA74.8
11
Science ReasoningGPQA Diamond
AUCOAA67.1
11
Showing 7 of 7 rows

Other info

Follow for update