Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Neural Green's Operators for Parametric Partial Differential Equations

About

This work introduces a paradigm for constructing parametric neural operators that are derived from finite-dimensional representations of Green's operators for linear partial differential equations (PDEs). We refer to such neural operators as Neural Green's Operators (NGOs). Our construction of NGOs preserves the linear action of Green's operators on the inhomogeneity fields, while approximating the nonlinear dependence of the Green's function on the coefficients of the PDE using neural networks. This construction reduces the complexity of the problem from learning the entire solution operator and its dependence on all parameters to only learning the Green's function and its dependence on the PDE coefficients. Furthermore, we show that our explicit representation of Green's functions enables the embedding of desirable mathematical attributes in our NGO architectures, such as symmetry, spectral, and conservation properties. Through numerical benchmarks on canonical PDEs, we demonstrate that NGOs achieve comparable or superior accuracy to Deep Operator Networks, Variationally Mimetic Operator Networks, and Fourier Neural Operators with similar parameter counts, while generalizing significantly better when tested on out-of-distribution data. For parametric time-dependent PDEs, we show that NGOs that are trained on a single time step can produce pointwise-accurate dynamics in an auto-regressive manner over arbitrarily large numbers of time steps. For parametric nonlinear PDEs, we demonstrate that NGOs trained exclusively on solutions of corresponding linear problems can be embedded within iterative solvers to yield accurate solutions, provided a suitable initial guess is available. Finally, we show that we can leverage the explicit representation of Green's functions returned by NGOs to construct effective matrix preconditioners that accelerate iterative solvers for PDEs.

Hugo Melchers, Joost Prins, Michael Abdelmalik• 2024

Related benchmarks

TaskDatasetResultRank
Solving linear systems from discretized diffusion equationsDiscretized diffusion equations 1000 realizations
Avg Iterations29.4
16
PDE solvingDataset C In-distribution 1.0 (test)
Relative L2 Error0.21
13
PDE solvingDataset C Out-of-distribution 1.0 (test)
Relative L2 Error6.68
13
Advection-diffusion predictionadvection diffusion (train)
Relative L2 Error6.82
11
Advection-diffusion predictionadvection diffusion (test)
Relative L2 Error7.66
11
Steady Diffusion PDE SolvingSteady Diffusion Problems
Time per Batch (ms)5.5
8
PDE solvingNonlinear Diffusion Problem (test)
Computing Time per Batch (ms)6.1
6
Showing 7 of 7 rows

Other info

Follow for update