Frequency Shift Physics-Informed Extreme Learning Machine for Solving High-Frequency Partial Differential Equations
About
Solving partial differential equations (PDEs) with high-frequency solutions remains a central challenge in physics-informed machine learning due to spectral bias -- the tendency of neural networks to learn low-frequency components preferentially. This paper proposes a Frequency Shift Physics-Informed Extreme Learning Machine (FS-PIELM) framework that addresses this limitation through an additive mechanism for weight initialization. Rather than multiplying random weights by a scaling factor, the method translates the mean of the Gaussian weight distribution while keeping the variance fixed at unity, thereby avoiding the variance amplification inherent in scaling-based methods. Two variants are developed: FS-PIELM-L assigns independent frequency magnitudes to individual neurons, while FS-PIELM-G groups neurons for improved robustness. Theoretical analysis shows that the frequency variance under the proposed framework remains bounded and approaches unity regardless of target frequency, in contrast to the quadratic growth of conventional approaches. The method preserves the computational efficiency of extreme learning machines, requiring only a single linear solve. Experiments on seven benchmark problems spanning six equation types -- Helmholtz, wave, Poisson, Klein-Gordon, heat, and advection-diffusion -- on both regular and complex geometries show that the linear variant achieves the best accuracy in six of seven cases, with improvements of one to nearly five orders of magnitude over existing PIELM variants. The code and data accompanying this manuscript will be made publicly available at https://github.com/xgxgnpu/Physics-informed-vibe-coding/tree/main/FS-PIELM.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| PDE solving | Klein-Gordon equation | Relative L2 Error1.01 | 36 | |
| PDE solving | 2D Convection-Diffusion | Relative L2 Error3.87 | 13 | |
| Partial Differential Equation Solving | Helmholtz-2D | Error1.07 | 8 | |
| Partial Differential Equation Solving | 2D advection-diffusion equation on Pacman domain | Best Rel. L2 Error3.87 | 5 | |
| Partial Differential Equation Solving | Poisson 1D | Relative L2 Error5.88 | 5 | |
| Partial Differential Equation Solving | Helmholtz Panda | Relative L2 Error1.59 | 5 | |
| PDE solving | 2D Helmholtz equation κ = 24π | Best Rel. L2 Error1.07 | 5 | |
| Solving 1D Poisson Equation | 1D Poisson equation multi-scale solution | Best Relative L2 Error5.88 | 5 | |
| Solving Helmholtz Equation | Panda-shaped domain | Best Rel. L2 Error1.59 | 5 | |
| Solving Klein-Gordon equation | Klein-Gordon equation with multiple frequency components | Best Relative L2 Error1.01 | 5 |