Geometric Neural Operators via Lie Group-Constrained Latent Dynamics
About
Neural operators offer an effective framework for learning solutions of partial differential equations for many physical systems in a resolution-invariant and data-driven manner. Existing neural operators, however, often suffer from instability in multi-layer iteration and long-horizon rollout, which stems from the unconstrained Euclidean latent space updates that violate the geometric and conservation laws. To address this challenge, we propose to constrain manifolds with low-rank Lie algebra parameterization that performs group action updates on the latent representation. Our method, termed Manifold Constraining based on Lie group (MCL), acts as an efficient \emph{plug-and-play} module that enforces geometric inductive bias to existing neural operators. Extensive experiments on various partial differential equations, such as 1-D Burgers and 2-D Navier-Stokes, over a wide range of parameters and steps demonstrate that our method effectively lowers the relative prediction error by 30-50\% at the cost of 2.26\% of parameter increase. The results show that our approach provides a scalable solution for improving long-term prediction fidelity by addressing the principled geometric constraints absent in the neural operator updates.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| PDE solving | Navier-Stokes 2D | MSE0.0026 | 26 | |
| PDE solving | 1D Burgers | MSE4.60e-5 | 26 | |
| Learning PDE Solution Operators | 2D Shallow Water | Mean L2 Relative Error0.1657 | 20 | |
| Partial Differential Equation Solving | 1-D Advection | MSE6.00e-5 | 12 | |
| Partial Differential Equation Solving | 1-D Diffusion | MSE0.00e+0 | 12 | |
| Partial Differential Equation Solving | 2-D Darcy Flow | MSE1.94e-4 | 12 |