Speeding Up Mixed-Integer Programming Solvers with Sparse Learning for Branching
About
Machine learning is increasingly used to improve decisions within branch-and-bound algorithms for mixed-integer programming. Many existing approaches rely on deep learning, which often requires very large training datasets and substantial computational resources for both training and deployment, typically with GPU parallelization. In this work, we take a different path by developing interpretable models that are simple but effective. We focus on approximating strong branching (SB) scores, a highly effective yet computationally expensive branching rule. Using sparse learning methods, we build models with fewer than 4% of the parameters of a state-of-the-art graph neural network (GNN) while achieving competitive accuracy. Relative to SCIP's built-in branching rules and the GNN-based model, our CPU-only models are faster than the default solver and the GPU-accelerated GNN. The models are simple to train and deploy, and they remain effective with small training sets, which makes them practical in low-resource settings. Extensive experiments across diverse problem classes demonstrate the efficiency of this approach.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Mixed Integer Linear Programming Solving | Capacitated Facility Location 200x100 (Medium) | Nodes Explored315 | 22 | |
| Combinatorial Optimization | Set Covering Small s | Time (s)3.7 | 18 | |
| Set Covering | Set Covering Large Problems | Solved Count69 | 6 | |
| Combinatorial Auctions | Combinatorial Auctions Large Problems | Success Rate100 | 6 | |
| Maximum Independent Set | Maximum Independent Set Small Problems | Success Rate100 | 6 | |
| Maximum Independent Set | Maximum Independent Set Medium Problems | Solution Size100 | 6 | |
| Maximum Independent Set | Maximum Independent Set Large Problems | Success Rate40 | 6 | |
| Mixed Integer Programming | Capacitated Facility Location Large Problems | Success Rate95 | 6 | |
| Set Covering | Set Covering Medium Problems | Solution Rate100 | 6 | |
| Combinatorial Auctions | Combinatorial Auctions Small Problems | Success Rate100 | 6 |