Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MixReasoning: Switching Modes to Think

About

Reasoning models enhance performance by tackling problems in a step-by-step manner, decomposing them into sub-problems and exploring long chains of thought before producing an answer. However, applying extended reasoning to every step introduces substantial redundancy, as sub-problems vary widely in difficulty and complexity: a small number of pivotal steps are genuinely challenging and decisive for the final answer, while many others only involve straightforward revisions or simple computations. Therefore, a natural idea is to endow reasoning models with the ability to adaptively respond to this variation, rather than treating all steps with the same level of elaboration. To this end, we propose MixReasoning, a framework that dynamically adjusts the depth of reasoning within a single response. The resulting chain of thought then becomes a mixture of detailed reasoning on difficult steps and concise inference on simpler ones. Experiments on GSM8K, MATH-500, and AIME show that MixReasoning shortens reasoning length and substantially improves efficiency without compromising accuracy.

Haiquan Lu, Gongfan Fang, Xinyin Ma, Qi Li, Xinchao Wang• 2025

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningGSM8K
Accuracy96.64
166
Mathematical ReasoningMATH 500
Average Tokens3.48e+3
104
Graduate-level STEM ReasoningGPQA Diamond
Pass@1 Accuracy62.87
23
Mathematical ReasoningMATH 500
Pass@1 Accuracy94.34
19
General ReasoningReasoning Benchmarks Average
Pass@181.28
16
Grade-school mathematical reasoningGSM8K
Pass@195.88
8
Mathematical ReasoningAIME 2024
Pass@1 Accuracy67.33
8
Science Question AnsweringGPQA Diamond
Pass@157.17
8
Code GenerationHumanEval
Pass@193.29
3
Commonsense ReasoningCommonsenseQA
Pass@183.9
3
Showing 10 of 14 rows

Other info

Follow for update