Projected Coupled Diffusion for Test-Time Constrained Joint Generation
About
Modifications to test-time sampling have emerged as an important extension to diffusion algorithms, with the goal of biasing the generative process to achieve a given objective without having to retrain the entire diffusion model. However, generating jointly correlated samples from multiple pre-trained diffusion models while simultaneously enforcing task-specific constraints without costly retraining has remained challenging. To this end, we propose Projected Coupled Diffusion (PCD), a novel test-time framework for constrained joint generation. PCD introduces a coupled guidance term into the generative dynamics to encourage coordination between diffusion models and incorporates a projection step at each diffusion step to enforce hard constraints. Empirically, we demonstrate the effectiveness of PCD in application scenarios of image-pair generation, object manipulation, and multi-robot motion planning. Our results show improved coupling effects and guaranteed constraint satisfaction without incurring excessive computational costs.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multi-Robot Motion Planning | Highways Medium, vmax=0.781 | Success Rate (%)100 | 30 | |
| Multi-Robot Motion Planning | Highways High vmax=0.878 | Success Rate100 | 30 | |
| Multi-Robot Motion Planning | Drop-Region Low (vmax=0.928) | Success Rate (SR)100 | 30 | |
| Multi-Robot Motion Planning | Drop-Region Medium (vmax=1.13) | Success Rate (SR)100 | 30 | |
| Multi-Robot Motion Planning | Drop-Region High (vmax=1.34) | Success Rate100 | 30 | |
| Multi-Robot Motion Planning | Empty Low velocity vmax=0.675 | Success Rate (SR)90 | 30 | |
| Multi-Robot Motion Planning | Highways Low, vmax=0.647 | Success Rate (SR)96 | 30 | |
| Multi-Robot Motion Planning | Empty Medium velocity, vmax=0.692 | Success Rate (SR)93 | 30 | |
| Multi-Robot Motion Planning | Empty High velocity, vmax=0.703 | Success Rate95 | 30 | |
| DropRegion | DropRegion 100 random (test) | Success Rate (SU)100 | 21 |