DC3: A learning method for optimization with hard constraints
About
Large optimization problems with hard constraints arise in many settings, yet classical solvers are often prohibitively slow, motivating the use of deep networks as cheap "approximate solvers." Unfortunately, naive deep learning approaches typically cannot enforce the hard constraints of such problems, leading to infeasible solutions. In this work, we present Deep Constraint Completion and Correction (DC3), an algorithm to address this challenge. Specifically, this method enforces feasibility via a differentiable procedure, which implicitly completes partial solutions to satisfy equality constraints and unrolls gradient-based corrections to satisfy inequality constraints. We demonstrate the effectiveness of DC3 in both synthetic optimization tasks and the real-world setting of AC optimal power flow, where hard constraints encode the physics of the electrical grid. In both cases, DC3 achieves near-optimal objective values while preserving feasibility.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Linear Programming | Linear Programming instances (test) | Computing Time2.1 | 27 | |
| Solving linear programming instances | Multi-dimensional knapsack linear programming (test) | Average Optimal Value274.8 | 18 | |
| Nonlinear resource-constrained production and inventory planning | Nonlinear production planning instances (test) | Avg Optimality Gap70.76 | 14 | |
| Inference Time Estimation | Convex large | Median Time7.2 | 10 | |
| Inference Time Estimation | Convex small | Median Latency0.0033 | 10 | |
| Non-Convex Programming Optimization | NCP (test) | Count Equality Violations0.00e+0 | 8 | |
| Optimization Solver Inference Time | Non-convex small (test) | Median Latency0.0019 | 8 | |
| Optimization Solver Inference Time | Non-convex large (test) | Inference Time (Median)0.0016 | 8 | |
| QCQP Optimization | QCQP (test) | # Equality Violations0.00e+0 | 7 | |
| Constrained Quadratic Programming | Constrained QP 100 variables, 50 equality constraints, 50 inequality constraints | Objective Value-13.44 | 7 |