Unsupervised Diffusion Solver for Combinatorial Optimization via Combinatorial Adjoint Matching
About
Diffusion-based neural solvers have shown strong promise for combinatorial optimization (CO), but existing methods typically rely on supervised training with large collections of near-optimal solutions. In this work, we extend adjoint-based trajectory optimization methods to discrete combinatorial domains. We formulate diffusion-based CO as a stochastic control problem over Continuous-Time Markov Chains and introduce discrete adjoint dynamics for propagating optimization signals through discrete generative trajectories. Building on this formulation, we propose Combinatorial Adjoint Matching (CAM), an unsupervised training framework for discrete diffusion solvers with structured and low-variance trajectory-level optimization signals. Empirically, CAM consistently outperforms existing unsupervised diffusion baselines and achieves performance competitive with strong supervised diffusion solvers and even traditional solvers across diverse combinatorial optimization problems. Our code is available at https://github.com/Shengyu-Feng/CAM.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Traveling Salesman Problem | TSP-500 (test) | Gap2.18 | 95 | |
| Capacitated Vehicle Routing Problem | CVRP N=100 | Objective Value15.98 | 87 | |
| Maximum Independent Set | ER [700-800] | Solution Size44.16 | 58 | |
| Traveling Salesman Problem | TSP-1000 (test) | Optimality Gap2.51 | 57 | |
| Maximum Independent Set | RB [200-300] | MIS Size19.91 | 38 | |
| Maximum Independent Set | ER [9000-11000] | MIS Size384.4 | 13 | |
| Maximum Cut | BA-[800-1200] (test) | Size2.96e+3 | 7 |