Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Thinking with Reasoning Skills: Fewer Tokens, More Accuracy

About

Reasoning LLMs often spend substantial tokens on long intermediate reasoning traces (e.g., chain-of-thought) when solving new problems. We propose to summarize and store reusable reasoning skills distilled from extensive deliberation and trial-and-error exploration, and to retrieve these skills at inference time to guide future reasoning. Unlike the prevailing \emph{reasoning from scratch} paradigm, our approach first recalls relevant skills for each query, helping the model avoid redundant detours and focus on effective solution paths. We evaluate our method on coding and mathematical reasoning tasks, and find that it significantly reduces reasoning tokens while improving overall performance. The resulting lower per-request cost indicates strong practical and economic potential for real-world deployment.

Guangxiang Zhao, Qilong Shi, Xusen Xiao, Xiangzheng Zhang, Tong Yang, Lin Sun• 2026

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningDEEPMATH-103K
Accuracy95.5
8
Competitive ProgrammingNEMOTRON-COMPETITIVE-PROGRAMMING V1
Accuracy71.7
8
Mathematical Reasoning120-question external contest-math suite (AIME 2024 I, AIME 2024 II, AIME 2025, AIME 2026, HMMT November 2025) AoPS-derived library
Accuracy Change1.88
5
Showing 3 of 3 rows

Other info

Follow for update