On the Collapse of Generative Paths: A Criterion and Correction for Diffusion Steering
About
Inference-time steering adapts pretrained diffusion and flow models to new tasks without retraining, often utilizing ratio-of-densities constructions that reweight time-indexed marginals with fixed exponents. We identify Marginal Path Collapse, a failure mode in which the intermediate density defined by such compositions becomes non-normalizable despite valid endpoints. This collapse can arise when composing heterogeneous experts trained with mismatched noise schedules (and/or negative exponents / partial supports). To address this, we provide (i) a sharp sufficient Path Existence Criterion that characterizes when the composed intermediate densities are mathematically well-defined, and (ii) Adaptive Path Correction with Exponents (ACE), which generalizes Feynman-Kac steering to support time-varying exponents. Our analysis reveals that ACE controls the quantile radius of the intermediate distributions, providing a theoretical mechanism for path stabilization observed in experiments. On flexible-pose scaffold decoration, a drug design task composed of de-novo, conformer, and protein-conditioned experts, ACE prevents collapse and significantly outperforms constant-exponent baselines. Furthermore, ACE improves attribute success rates in compositional image generation, establishing it as a general framework for compositional sampling. Project Page: https://ziseoklee.github.io/projects/ACE/
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Scaffold decoration | CrossDock Weak | Validity (%)100 | 20 | |
| Scaffold decoration | CrossDock-SBDD | Validity100 | 20 | |
| Compositional Image Generation | COCO-MIG L2 | Instance Attr Success Ratio46.25 | 14 | |
| Compositional Image Generation | COCO-MIG L3 | Instance Attribute Success Ratio42.5 | 14 | |
| Compositional Image Generation | COCO-MIG L4 | Instance Attribute Success Ratio41.72 | 14 | |
| Compositional Image Generation | COCO-MIG L5 | Instance Attribute Success Ratio38.38 | 14 | |
| Compositional Image Generation | COCO-MIG L6 | Instance Attribute Success Ratio0.349 | 14 | |
| Compositional Image Generation | COCO-MIG Avg | Instance Attribute Success Ratio40.46 | 14 |