DPM: A Novel Training Method for Physics-Informed Neural Networks in Extrapolation
About
We present a method for learning dynamics of complex physical processes described by time-dependent nonlinear partial differential equations (PDEs). Our particular interest lies in extrapolating solutions in time beyond the range of temporal domain used in training. Our choice for a baseline method is physics-informed neural network (PINN) [Raissi et al., J. Comput. Phys., 378:686--707, 2019] because the method parameterizes not only the solutions but also the equations that describe the dynamics of physical processes. We demonstrate that PINN performs poorly on extrapolation tasks in many benchmark problems. To address this, we propose a novel method for better training PINN and demonstrate that our newly enhanced PINNs can accurately extrapolate solutions in time. Our method shows up to 72% smaller errors than existing methods in terms of the standard L2-norm metric.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Solving reaction equations | Reaction equations | Max Error0.2055 | 28 | |
| Solving reaction equations | Reaction equations (test) | Max Error0.2055 | 16 | |
| Solving reaction equations | Reaction equations (ρ=6) 1.0 (test) | Absolute Error0.0403 | 14 | |
| Solving reaction equations | Reaction equations (ρ=4) 1.0 (test) | Absolute Error0.026 | 14 | |
| Solving reaction equations | Reaction equations (ρ=5) 1.0 (test) | Absolute Error0.0334 | 10 | |
| Solving reaction equations | Reaction equations ρ=7 1.0 (test) | Absolute Error0.0275 | 10 | |
| PDE solving | Reaction-Diffusion (Reac.-Diff.) PDE general cases Gaussian distribution N(pi, (pi/2)^2) initial condition | Absolute Error0.1876 | 7 | |
| PDE solving | Convection-Diffusion-Reaction (C-D-R) PDE Gaussian distribution N(pi, (pi/2)^2) initial condition (general cases) | Absolute Error0.1629 | 7 | |
| PDE solving | Convection PDE general cases Gaussian distribution N(pi, (pi/2)^2) initial condition | Absolute Error0.0222 | 7 | |
| PDE solving | Reaction PDE Gaussian distribution N(pi, (pi/2)^2) initial condition (general cases) | Abs. Err.0.3336 | 7 |