Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AdamFLIP: Adaptive Momentum Feedback Linearization Optimization for Hard Constrained PINN Training

About

Physics-informed neural networks (PINNs) provide a flexible framework for solving forward and inverse problems governed by partial differential equations (PDEs), but standard PINN training typically relies on soft penalty formulations that combine PDE residuals, data mismatch, and initial/boundary conditions using manually chosen weights. This often leads to ill-conditioning, sensitivity to loss weights, and poor constraint satisfaction. In this work, we reformulate PINN training as an equality-constrained optimization problem and propose a novel Adaptive Momentum Feedback Linearization Optimization for Hard Constrained PINN (AdamFLIP). The key idea is to view the constraint residuals as the output of a controlled dynamical system and to compute the Lagrange multiplier as a feedback input that locally drives these residuals toward stable linear contraction dynamics. AdamFLIP then applies Adam-style first- and second-moment adaptation to the resulting feedback-linearized Lagrangian gradient, combining principled constraint handling with the scalability and robustness of adaptive neural-network optimization. We test AdamFLIP on a range of benchmark forward and inverse PDE problem, and it consistently outperforms both the standard soft-constrained PINN and state-of-the-art constrained optimizers. Specifically, on the Navier--Stokes equations benchmark, AdamFLIP \textbf{reduces relative $L_2$ error by more than two thirds} for the predicted solution compared to the next best method. Our AdamFLIP framework provides an effective and computationally scalable hard constraint optimization method for PINN training.

Binghang Lu, Runyu Zhang, Changhong Mou, Na Li, Guang Lin• 2026

Related benchmarks

TaskDatasetResultRank
Forward 2D Navier-StokesTaylor-Green vortex 2D Navier-Stokes
Mean L2 Error (u)1.18
5
Forward Numerical PDE SolvingTime-fractional Mixed Diffusion-Wave Equation (TFMDWE)
Relative L2 Error2.85
5
Inverse Problem Solving2D heat equation inverse problem
Relative L2 Error1.59
5
Inverse fractional PDE problem1D time-fractional mixed diffusion-wave equation Inverse
Relative L2 Error0.0395
5
Forward problem1D Burgers Equation
Relative L2 Error3.12
5
Inverse Parameter Estimation2D Heat Equation
Kappa Hat Estimate0.0995
5
Parameter Estimation1D Burgers' Equation Inverse Problem Setting
Estimated Kappa 11.0154
5
Forward PDE solving2D Heat Equation homogeneous Dirichlet condition u = 0 (test)
Rel. L2 Error7.53
5
Inverse PDE solving1D Burgers equation inverse problem
Relative L2 Error5.74
5
Showing 9 of 9 rows

Other info

Follow for update