MetaColloc: Optimization-Free PDE Solving via Meta-Learned Basis Functions
About
Solving partial differential equations (PDEs) with machine learning typically requires training a new neural network for every new equation. This optimization is slow. We introduce MetaColloc. It is an optimization-free and data-free framework that removes this bottleneck completely. We decouple basis discovery from the solving process. We meta-train a dual-branch neural network on diverse Gaussian Random Fields. This offline process creates a universal dictionary of neural basis functions. At test time, we freeze the network. We solve the PDE by assembling a collocation matrix. We find the solution through a single linear least squares step. For non-linear PDEs, we apply the Newton-Raphson method to achieve fast quadratic convergence. Our experiments across six 2D and 3D PDEs show massive improvements. MetaColloc reaches state-of-the-art accuracy on smooth and non-linear problems. It also reduces test-time computation by several orders of magnitude. Finally, we provide a detailed frequency sweep analysis. This analysis reveals a critical mismatch between function approximation and operator stability at extremely high frequencies. This profound finding opens a clear path toward future operator-aware meta-learning.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| PDE solving | Poisson | L2 Error4.04e-5 | 30 | |
| PDE solving | VarCoeff | RMSE1.86e-9 | 17 | |
| PDE solving | SineGordon | RMSE6.03e-8 | 17 | |
| PDE solving | KdV | RMSE1.30e-4 | 17 | |
| PDE solving | Helmholtz | RMSE (Helmholtz)0.5 | 17 | |
| PDE solving | HighFreq Poisson | RMSE0.781 | 17 |