FSNet: Feasibility-Seeking Neural Network for Constrained Optimization with Guarantees
About
Efficiently solving constrained optimization problems is crucial for numerous real-world applications, yet traditional solvers are often computationally prohibitive for real-time use. Machine learning-based approaches have emerged as a promising alternative to provide approximate solutions at faster speeds, but they struggle to strictly enforce constraints, leading to infeasible solutions in practice. To address this, we propose the Feasibility-Seeking Neural Network (FSNet), which integrates a feasibility-seeking step directly into its solution procedure to ensure constraint satisfaction. This feasibility-seeking step solves an unconstrained optimization problem that minimizes constraint violations in a differentiable manner, enabling end-to-end training and providing guarantees on feasibility and convergence. Our experiments across a range of different optimization problems, including both smooth/nonsmooth and convex/nonconvex problems, demonstrate that FSNet can provide feasible solutions with solution quality comparable to (or in some cases better than) traditional solvers, at significantly faster speeds.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Constrained Optimization | Concentric Circles Quadratic objective | Feasibility (%)99.9 | 13 | |
| Constrained Optimization | Concentric Circles Linear objective | Feasibility (%)98.5 | 13 | |
| Constrained Optimization | Concentric Circles Dist. Min. objective | Feasibility99.1 | 13 | |
| Constrained Optimization (Distance Minimization Objective) | Two Moons 1,500 problems (test) | Feasibility99.3 | 13 | |
| Constrained Optimization (Linear Objective) | Two Moons 1,500 problems (test) | Feasibility (%)98.3 | 13 | |
| Constrained Optimization (Quadratic Objective) | Two Moons 1,500 problems (test) | Feasibility (%)98.7 | 13 | |
| Distance Minimization | Star Shaped constraint family (test) | Feasibility (%)99.7 | 13 | |
| Distance Minimization Constrained Optimization | Blob with Bite | Feasibility (%)99.8 | 13 | |
| Linear Constrained Optimization | Blob with Bite | Feasibility (%)98.7 | 13 | |
| Quadratic Constrained Optimization | Blob with Bite | Feasibility (%)99.5 | 13 |