Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Cast a Wider Net: Coordinated Pass@K Policy Optimization for Code Reasoning

About

Repeated sampling with a verifier is the standard way to allocate test-time compute for code generation, with pass@$K$ as the canonical metric. Yet the standard policy class draws $K$ independent samples from a single answer distribution, so attempts often collapse onto near-duplicate reasoning paths and waste the budget on redundant rollouts. This failure is costly in competitive programming, where many problems admit multiple distinct algorithmic strategies and pass@$K$ requires only one correct attempt. We propose Coordinated Pass@$K$ Policy Optimization (CPPO), which turns pass@$K$ generation into joint exploration over strategies: a planner emits a tuple of $K{=}4$ alternative high-level methods, and a shared solver attempts one solution per method. CPPO trains this joint policy with a multiplicative planner reward, $R_{\mathrm{plan}} = J_\psi \cdot R_{\mathrm{out}}$, assigning credit only to valid strategy tuples that lead to verifier-confirmed pass@$K$ success. Across APPS, CodeContests, and LiveCodeBench-v6, CPPO improves pass@$4$ over direct sampling, planning baselines, planner-only SFT, and pass@$K$-oriented RL under the same $K{=}4$ solver-attempt budget, with statistically significant gains on six of nine model--benchmark cells. The largest single gain is $+0.16$ on Qwen3.5-9B LiveCodeBench-v6 over the strongest baseline, PKPO ($0.588 \rightarrow 0.748$; paired bootstrap, $p < 0.05$).

Yilong Li, Suman Banerjee, Tong Che• 2026

Related benchmarks

TaskDatasetResultRank
Code GenerationCodeContests (test)--
68
Code GenerationAPPS (test)--
36
Code GenerationAPPS Introductory--
25
Code GenerationCodeContests official (val)
Pass@443.6
24
Code GenerationLiveCodeBench LCBv6 (held-out)
Pass@474.8
24
Code GenerationLiveCodeBench v6 (test)
Pass@474.8
16
Code GenerationAPPS
Pass@483.2
12
Code GenerationLiveCodeBench v6
Pass@462.9
12
Output PredictionLiveCodeBench (LCB) output-prediction
Code Execution Success Rate51
10
Code GenerationLCB v6 (fixed 500-problem slice)
Pass@453.5
6
Showing 10 of 11 rows

Other info

Follow for update