Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Intrinsic Selection and Particle Resampling for Inference-Time Scaling Beyond Domain Verifiability

About

Inference-Time Scaling (ITS) has largely succeeded in verifiable domains like math and coding, where cheap verification enables scalable output selection. However, extending ITS to tasks prone to systematic failure - driven by faulty initial assumptions or unmet multidimensional constraints - typically relies on costly external solvers or brittle, model-based verifiers. Our key insight is that the intrinsic statistics of parallel sample sets, specifically length-adjusted tail entropy, provide a robust discriminative signal for solution quality without access to ground truth. Crucially, these statistics serve as a difficulty gate for adaptive compute allocation, dynamically routing problems across scaling regimes. First, Intrinsic Selection (iS) ranks candidates post-hoc, matching consensus-based algorithms across three domains and improving engineering design selection by 20% over pass@1 baselines. Second, Intrinsic Particle Filtering (iPF) generalizes this to step-level resampling, guiding generation toward high-confidence reasoning trajectories to improve pass@1 by 6.1 points on average on hard math problems. Finally, Particle Distillation (dPF) injects privileged guidance via early logit blending and KL-guided resampling, steering generation past systematic reasoning errors to satisfy expert rubrics, yielding up to 26.5% gains on complex clinical responses. Our pipeline applies seamlessly across broad-purpose, domain-specialized, and multimodal architectures, successfully extending ITS to open-ended domains without requiring trained reward models or exact ground-truth verification.

Giorgio Giannone, Mustafa Eyceoz, Shabana Baig, Shivchander Sudalairaj, Anna C. Doris, Faez Ahmed, Akash Srivastava, Kai Xu• 2026

Related benchmarks

TaskDatasetResultRank
MathematicsAIME 2024
Accuracy67.5
87
MathematicsAIME 2025
Accuracy49.9
74
Medical ReasoningHealthBench Hard--
41
MathematicsHMMT 2026
Accuracy34.8
16
Mathematical Problem SolvingHMMT 2025
Accuracy35
16
Mathematical ReasoningAIME 2025 (val)
Accuracy52.5
11
Mathematical ReasoningHMMT 2025 (val)
Accuracy38.3
4
Mathematical ReasoningHMMT 2026 (val)
Accuracy37.1
4
CodingLiveCodeBench v6
Accuracy21.5
4
Mathematical ReasoningAIME 2026 (val)
Accuracy64.2
4
Showing 10 of 13 rows

Other info

Follow for update