Intrinsic Selection and Particle Resampling for Inference-Time Scaling Beyond Domain Verifiability
About
Inference-Time Scaling (ITS) has largely succeeded in verifiable domains like math and coding, where cheap verification enables scalable output selection. However, extending ITS to tasks prone to systematic failure - driven by faulty initial assumptions or unmet multidimensional constraints - typically relies on costly external solvers or brittle, model-based verifiers. Our key insight is that the intrinsic statistics of parallel sample sets, specifically length-adjusted tail entropy, provide a robust discriminative signal for solution quality without access to ground truth. Crucially, these statistics serve as a difficulty gate for adaptive compute allocation, dynamically routing problems across scaling regimes. First, Intrinsic Selection (iS) ranks candidates post-hoc, matching consensus-based algorithms across three domains and improving engineering design selection by 20% over pass@1 baselines. Second, Intrinsic Particle Filtering (iPF) generalizes this to step-level resampling, guiding generation toward high-confidence reasoning trajectories to improve pass@1 by 6.1 points on average on hard math problems. Finally, Particle Distillation (dPF) injects privileged guidance via early logit blending and KL-guided resampling, steering generation past systematic reasoning errors to satisfy expert rubrics, yielding up to 26.5% gains on complex clinical responses. Our pipeline applies seamlessly across broad-purpose, domain-specialized, and multimodal architectures, successfully extending ITS to open-ended domains without requiring trained reward models or exact ground-truth verification.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Mathematics | AIME 2024 | Accuracy67.5 | 87 | |
| Mathematics | AIME 2025 | Accuracy49.9 | 74 | |
| Medical Reasoning | HealthBench Hard | -- | 41 | |
| Mathematics | HMMT 2026 | Accuracy34.8 | 16 | |
| Mathematical Problem Solving | HMMT 2025 | Accuracy35 | 16 | |
| Mathematical Reasoning | AIME 2025 (val) | Accuracy52.5 | 11 | |
| Mathematical Reasoning | HMMT 2025 (val) | Accuracy38.3 | 4 | |
| Mathematical Reasoning | HMMT 2026 (val) | Accuracy37.1 | 4 | |
| Coding | LiveCodeBench v6 | Accuracy21.5 | 4 | |
| Mathematical Reasoning | AIME 2026 (val) | Accuracy64.2 | 4 |