Boosting Cross-problem Generalization in Diffusion-Based Neural Combinatorial Solver via Inference Time Adaptation
About
Diffusion-based Neural Combinatorial Optimization (NCO) has demonstrated effectiveness in solving NP-complete (NPC) problems by learning discrete diffusion models for solution generation, eliminating hand-crafted domain knowledge. Despite their success, existing NCO methods face significant challenges in both cross-scale and cross-problem generalization, and high training costs compared to traditional solvers. While recent studies on diffusion models have introduced training-free guidance approaches that leverage pre-defined guidance functions for conditional generation, such methodologies have not been extensively explored in combinatorial optimization. To bridge this gap, we propose a training-free inference time adaptation framework (DIFU-Ada) that enables both the zero-shot cross-problem transfer and cross-scale generalization capabilities of diffusion-based NCO solvers without requiring additional training. We provide theoretical analysis that helps understanding the cross-problem transfer capability. Our experimental results demonstrate that a diffusion solver, trained exclusively on the Traveling Salesman Problem (TSP), can achieve competitive zero-shot transfer performance across different problem scales on TSP variants, such as Prize Collecting TSP (PCTSP) and the Orienteering Problem (OP), through inference time adaptation.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Prize Collecting Traveling Salesperson Problem | PCTSP-20 | Optimality Gap4.2 | 15 | |
| Prize Collecting Traveling Salesperson Problem | PCTSP-50 | Optimality Gap3.57 | 14 | |
| Prize Collecting Traveling Salesperson Problem | PCTSP-100 | Optimality Gap9.61 | 14 | |
| Orienteering Problem | OP-20 | Optimality Gap3.11 | 12 | |
| Prize-Collecting Traveling Salesman Problem | PCTSP Average across scales 20, 50, 100 | Average Optimality Gap9.7 | 11 | |
| Orienteering Problem | OP-50 | Gap6.11 | 8 | |
| Orienteering Problem | OP Average across scales 20 50 100 | Average Gap7.26 | 8 | |
| Prize-Collecting Traveling Salesman Problem | PCTSP 500 | Cost14.5 | 6 | |
| Prize-Collecting Traveling Salesman Problem | PCTSP-1000 | Cost21.7 | 6 | |
| Orienteering Problem | OP-50 | Prize28.21 | 3 |