On the Collapse of Generative Paths: A Criterion and Correction for Diffusion Steering
About
Inference-time steering enables pretrained diffusion/flow models to be adapted to new tasks without retraining. A widely used approach is the ratio-of-densities method, which defines a time-indexed target path by reweighting probability-density trajectories from multiple models with positive, or in some cases, negative exponents. This construction, however, harbors a critical and previously unformalized failure mode: Marginal Path Collapse, where intermediate densities become non-normalizable even though endpoints remain valid. Collapse arises systematically when composing heterogeneous models trained on different noise schedules or datasets, including a common setting in molecular design where de-novo, conformer, and pocket-conditioned models must be combined for tasks such as flexible-pose scaffold decoration. We provide a novel and complete solution for the problem. First, we derive a simple path existence criterion that predicts exactly when collapse occurs from noise schedules and exponents alone. Second, we introduce Adaptive path Correction with Exponents (ACE), which extends Feynman-Kac steering to time-varying exponents and guarantees a valid probability path. On a synthetic 2D benchmark and on flexible-pose scaffold decoration, ACE eliminates collapse and enables high-guidance compositional generation, improving distributional and docking metrics over constant-exponent baselines and even specialized task-specific scaffold decoration models. Our work turns ratio-of-densities steering with heterogeneous experts from an unstable heuristic into a reliable tool for controllable generation.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Scaffold decoration | CrossDock Weak | Validity (%)100 | 20 | |
| Scaffold decoration | CrossDock-SBDD | Validity100 | 20 | |
| Compositional Image Generation | COCO-MIG L2 | Instance Attr Success Ratio46.25 | 14 | |
| Compositional Image Generation | COCO-MIG L3 | Instance Attribute Success Ratio42.5 | 14 | |
| Compositional Image Generation | COCO-MIG L4 | Instance Attribute Success Ratio41.72 | 14 | |
| Compositional Image Generation | COCO-MIG L5 | Instance Attribute Success Ratio38.38 | 14 | |
| Compositional Image Generation | COCO-MIG L6 | Instance Attribute Success Ratio0.349 | 14 | |
| Compositional Image Generation | COCO-MIG Avg | Instance Attribute Success Ratio40.46 | 14 |