Projected Coupled Diffusion for Test-Time Constrained Joint Generation
About
Modifications to test-time sampling have emerged as an important extension to diffusion algorithms, with the goal of biasing the generative process to achieve a given objective without having to retrain the entire diffusion model. However, generating jointly correlated samples from multiple pre-trained diffusion models while simultaneously enforcing task-specific constraints without costly retraining has remained challenging. To this end, we propose Projected Coupled Diffusion (PCD), a novel test-time framework for constrained joint generation. PCD introduces a coupled guidance term into the generative dynamics to encourage coordination between diffusion models and incorporates a projection step at each diffusion step to enforce hard constraints. Empirically, we demonstrate the effectiveness of PCD in application scenarios of image-pair generation, object manipulation, and multi-robot motion planning. Our results show improved coupling effects and guaranteed constraint satisfaction without incurring excessive computational costs.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| DropRegion | DropRegion 100 random (test) | Success Rate (SU)100 | 21 | |
| Multi-robot navigation | Task Empty 100 random 4 robots (test) | Success Rate (%)100 | 21 | |
| Robot navigation | Highways 2 robots | Success Rate (SU)100 | 21 | |
| Conveyor Multi-Robot Navigation | Conveyor 100 random 4 robots (test) | SU (%)100 | 21 | |
| Robot Manipulation | PushT vmax = 8.4 (test) | DTW4.38 | 20 | |
| Multi-robot path planning | Empty 2 robots, Max Vel. = 0.703 | Success Rate (SU)100 | 14 | |
| PushT task | PushT Max Vel. = 6.2 1.0 (test) | DTW Distance4.32 | 10 | |
| PushT task | PushT Max Vel. = 10.7 1.0 (test) | DTW4.39 | 10 | |
| DropRegion | DropRegion Max Vel. = 0.928 | Success Rate (SU)100 | 7 | |
| DropRegion | DropRegion Max Vel. = 1.13 | Success Rate (%)100 | 7 |