Learning to Control Local Search for Combinatorial Optimization
About
Combinatorial optimization problems are encountered in many practical contexts such as logistics and production, but exact solutions are particularly difficult to find and usually NP-hard for considerable problem sizes. To compute approximate solutions, a zoo of generic as well as problem-specific variants of local search is commonly used. However, which variant to apply to which particular problem is difficult to decide even for experts. In this paper we identify three independent algorithmic aspects of such local search algorithms and formalize their sequential selection over an optimization process as Markov Decision Process (MDP). We design a deep graph neural network as policy model for this MDP, yielding a learned controller for local search called NeuroLS. Ample experimental evidence shows that NeuroLS is able to outperform both, well-known general purpose local search controllers from Operations Research as well as latest machine learning-based approaches.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Job Shop Scheduling | Taillard's benchmark Avg | Performance Gap (PG)11.3 | 57 | |
| Minimizing triangulation diameter | simplicial polytopes in 3D unseen | Relative Gap3.9 | 12 | |
| Minimizing triangulation weight | simplicial polytopes in 3D unseen | Relative Gap8.12 | 12 | |
| Minimizing number of simplices | unseen simplicial polytopes in 3D | Relative Gap13 | 12 | |
| Triangulation Optimization (Minimizing Simplices) | Simplicial Polytopes 4D (|V|=14) (Unseen) | Relative Gap10.89 | 7 | |
| Triangulation Optimization (Minimizing Weight) | Simplicial Polytopes in 4D Unseen |V|=13 | Relative Gap2.5 | 7 | |
| Triangulation Optimization (Minimizing Diameter) | Unseen Simplicial Polytopes in 4D (|V|=13) | Relative Gap13 | 7 | |
| Triangulation Optimization (Minimizing Diameter) | Unseen Simplicial Polytopes in 4D (|V|=14) | Relative Gap14.67 | 7 | |
| Triangulation Optimization (Minimizing Weight) | Simplicial Polytopes Unseen 4D (|V|=14) | Relative Gap2.22 | 7 | |
| Triangulation Optimization (Overall Average Performance) | Unseen Simplicial Polytopes in 4D Aggregate | Relative Gap9.09 | 7 |