Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LAPO: Internalizing Reasoning Efficiency via Length-Adaptive Policy Optimization

About

Large reasoning models have achieved remarkable performance through extended chain-of-thought sequences, yet this computational freedom leads to excessive token generation even for simple problems. We present Length-Adaptive Policy Optimization (LAPO), a novel framework that transforms reasoning length control from an external constraint into an intrinsic model capability. Unlike existing approaches that impose rigid limits or rely on post-hoc interventions, LAPO enables models to internalize an understanding of appropriate reasoning depth through a two-stage reinforcement learning process. In the first stage, models learn natural reasoning patterns by discovering the statistical distribution of successful solution lengths. The second stage leverages these patterns as meta-cognitive guidance, embedding them directly within the model's reasoning context to ensure inference-time flexibility. Experiments on mathematical reasoning benchmarks demonstrate that LAPO reduces token usage by up to 40.9% while improving accuracy by 2.3%. Our analysis reveals that models trained with LAPO develop emergent abilities to allocate computational resources based on problem complexity, achieving efficient reasoning without sacrificing quality.

Xingyu Wu, Yuchen Yan, Shangke Lyu, Linjuan Wu, Yiwen Qiu, Yongliang Shen, Weiming Lu, Jian Shao, Jun Xiao, Yueting Zhuang• 2025

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningAIME 24
Accuracy38.1
318
Mathematical ReasoningOlympiadBench
Accuracy56.3
213
Mathematical ReasoningMATH500
Accuracy86.6
86
General ReasoningGeneral Reasoning Suite Average
Pass@137.77
63
Math ReasoningMATH
Pass@186.04
18
Logical Reasoning Question AnsweringLSAT
Pass@10.2842
17
Mathematical ReasoningAMC 23
Accuracy78.3
11
Math ReasoningAIME 2025
Pass@127.92
6
General ReasoningGPQA Diamond
Pass@1 Accuracy36.17
6
Math ReasoningOlympiadBench
Pass@148.18
6
Showing 10 of 14 rows

Other info

Follow for update