Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Models

About

Vision-Language-Action (VLA) models provide a unified paradigm for robotic manipulation, yet their real-world deployment is often bottlenecked by execution efficiency. While existing efforts predominantly focus on compute-centric efficiency to reduce per-step inference latency, the intrinsic \textbf{policy efficiency} of these models remains largely unexplored. Policy efficiency is fundamentally affected by two factors, namely the effective executable length of predicted action chunks and the total physical steps required to complete a task. These two factors jointly determine the total number of forward inference calls during execution. We observe that current VLA policies struggle with planning unreliability and action redundancy, suffering from severe prediction degradation at the tail of action chunks and tending to generate unnecessarily redundant physical steps. To address this, we propose \textbf{PolicyTrim}, a reinforcement learning-based post-training framework that extends the reliable action chunk length and reduces redundant physical steps. For reliable chunk extension, we employ a dynamic exploration strategy that explicitly rewards the successful completion of longer executable lengths, progressively pushing the trustworthy prediction horizon to its empirical limit. For step efficiency, we design a redundancy-aware reward that directly favors successful task completions with fewer steps while penalizing unreproducible shortcuts, effectively eliminating redundant physical actions. Extensive experiments across three benchmarks and three VLA models demonstrate that PolicyTrim improves action chunk utilization by 3$\times$ and reduces physical execution steps by 51.4\%. Ultimately, our framework delivers up to a 5.83$\times$ end-to-end deployment speedup without compromising task success rates.

Xianghui Wang, Feng Chen, Wenbo Zhang, Hua Yan, Zixuan Wang, Changsheng Li, Yinjie Lei• 2026

Related benchmarks

TaskDatasetResultRank
Robot ManipulationLIBERO Object
Success Rate98.5
139
Robotic ManipulationLIBERO Long
Success Rate93.3
97
Robotic ManipulationLIBERO Goal
Success Rate98.8
55
Robotic ManipulationManiSkill
Average Success Rate89.8
10
Robotic ManipulationLIBERO Spatial
Success Rate (SR)98.8
6
Robot ManipulationLIBERO
Success Rate (SR)98.8
4
Robotic ManipulationMeta-World
Success Rate (SR)65.4
2
Tabletop manipulationFlipMug (Standard)
Success Rate (%)75
2
Tabletop manipulationHangMug Standard
Success Rate65
2
Tabletop manipulationTapeBox (Dynamic)
Success Rate70
2
Showing 10 of 12 rows

Other info

GitHub

Follow for update