Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DC3: A learning method for optimization with hard constraints

About

Large optimization problems with hard constraints arise in many settings, yet classical solvers are often prohibitively slow, motivating the use of deep networks as cheap "approximate solvers." Unfortunately, naive deep learning approaches typically cannot enforce the hard constraints of such problems, leading to infeasible solutions. In this work, we present Deep Constraint Completion and Correction (DC3), an algorithm to address this challenge. Specifically, this method enforces feasibility via a differentiable procedure, which implicitly completes partial solutions to satisfy equality constraints and unrolls gradient-based corrections to satisfy inequality constraints. We demonstrate the effectiveness of DC3 in both synthetic optimization tasks and the real-world setting of AC optimal power flow, where hard constraints encode the physics of the electrical grid. In both cases, DC3 achieves near-optimal objective values while preserving feasibility.

Priya L. Donti, David Rolnick, J. Zico Kolter• 2021

Related benchmarks

TaskDatasetResultRank
Linear ProgrammingLinear Programming instances (test)
Computing Time2.1
27
Constrained Optimization (Linear Constraints)Optimization 1 TE1 in-distribution (test)
Normalized Loss0.6789
19
Constrained Optimization (Linear Constraints)Optimization 1 TE1 out-of-distribution (test)
Normalized Loss0.9968
19
Constrained Optimization (Linear and Convex Quadratic Constraints)Optimization TE2 out-of-distribution 2 (test)
Normalized Loss0.3104
18
Solving linear programming instancesMulti-dimensional knapsack linear programming (test)
Average Optimal Value274.8
18
Constrained Optimization (Linear and Convex Quadratic Constraints)Optimization 2 TE2 in-distribution (test)
Normalized Loss0.1978
18
Nonlinear resource-constrained production and inventory planningNonlinear production planning instances (test)
Avg Optimality Gap70.76
14
Inference Time EstimationConvex large
Median Time7.2
10
Inference Time EstimationConvex small
Median Latency0.0033
10
Non-Convex Programming OptimizationNCP (test)
Count Equality Violations0.00e+0
8
Showing 10 of 33 rows

Other info

Follow for update