Separated-Variable Spectral Neural Networks: A Physics-Informed Learning Approach for High-Frequency PDEs
About
Solving high-frequency oscillatory partial differential equations (PDEs) is a critical challenge in scientific computing, with applications in fluid mechanics, quantum mechanics, and electromagnetic wave propagation. Traditional physics-informed neural networks (PINNs) suffer from spectral bias, limiting their ability to capture high-frequency solution components. We introduce Separated-Variable Spectral Neural Networks (SV-SNN), a novel framework that addresses these limitations by integrating separation of variables with adaptive spectral methods. Our approach features three key innovations: (1) decomposition of multivariate functions into univariate function products, enabling independent spatial and temporal networks; (2) adaptive Fourier spectral features with learnable frequency parameters for high-frequency capture; and (3) theoretical framework based on singular value decomposition to quantify spectral bias. Comprehensive evaluation on benchmark problems including Heat equation, Helmholtz equation, Poisson equations and Navier-Stokes equations demonstrates that SV-SNN achieves 1-3 orders of magnitude improvement in accuracy while reducing parameter count by over 90\% and training time by 60\%. These results establish SV-SNN as an effective solution to the spectral bias problem in neural PDE solving. The implementation will be made publicly available upon acceptance at https://github.com/xgxgnpu/SV-SNN.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Solving 2D Helmholtz equations | Two-dimensional Helmholtz equations (k = 24π) (test) | Average L2 Error0.0127 | 6 | |
| Partial Differential Equation Solving | Taylor-Green vortex | u L-inf Error0.0024 | 3 | |
| Solving heat conduction equations | Heat conduction equation (21) (k = 20π) (test) | L-infinity Error3.90e-4 | 3 | |
| Solving heat conduction equations | Heat conduction equation (21) (k = 100π) (test) | eL∞ Error0.0157 | 3 | |
| Solving heat conduction equations | Heat conduction equation (21) (k = 500π) (test) | eL∞ Error0.0445 | 3 | |
| Solving Helmholtz Equation | Complex geometry Helmholtz equation k = 24π (test) | L-infinity Error0.124 | 3 | |
| Solving Nonlinear Elliptic Equations | Nonlinear elliptic equations | L-infinity Error0.0072 | 3 | |
| Solving Poisson Equations | Complex source term Poisson equations (24) | L-infinity Error0.0113 | 3 | |
| Solving Two-dimensional Helmholtz Equation | Two-dimensional Helmholtz equation k = 24π | L∞ Error0.0362 | 3 | |
| Solving Two-dimensional Helmholtz Equation | Two-dimensional Helmholtz equation (k = 48π) | L-infinity Error0.0549 | 3 |