PDE Solvers Should Be Local: Fast, Stable Rollouts with Learned Local Stencils
About
Neural operator models for solving partial differential equations (PDEs) often rely on global mixing mechanisms-such as spectral convolutions or attention-which tend to oversmooth sharp local dynamics and introduce high computational cost. We present FINO, a finite-difference-inspired neural architecture that enforces strict locality while retaining multiscale representational power. FINO replaces fixed finite-difference stencil coefficients with learnable convolutional kernels and evolves states via an explicit, learnable time-stepping scheme. A central Local Operator Block leverage a differential stencil layer, a gating mask, and a linear fuse step to construct adaptive derivative-like local features that propagate forward in time. Embedded in an encoder-decoder with a bottleneck, FINO captures fine-grained local structures while preserving interpretability. We establish (i) a composition error bound linking one-step approximation error to stable long-horizon rollouts under a Lipschitz condition, and (ii) a universal approximation theorem for discrete time-stepped PDE dynamics. (iii) Across six benchmarks and a climate modelling task, FINO achieves up to 44\% lower error and up to around 2\times speedups over state-of-the-art operator-learning baselines, demonstrating that strict locality with learnable time-stepping yields an accurate and scalable foundation for neural PDE solvers.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Operator Learning Rollout Prediction | Allen-Cahn Equation E2 | MSE2.00e-5 | 35 | |
| Operator Learning Rollout Prediction | Burgers' Equation E1 | MSE0.00e+0 | 28 | |
| Operator Learning Rollout Prediction | E3 Kuramoto-Sivashinsky Equation | MSE0.00e+0 | 28 | |
| Operator Learning Rollout Prediction | E5 Navier-Stokes Equation | MSE0.00e+0 | 28 | |
| Operator Learning Rollout Prediction | Navier-Stokes Equation E4 | MSE0.00e+0 | 28 | |
| Operator Learning Rollout Prediction | E6 Navier-Stokes Equation | MSE2.00e-5 | 28 | |
| Non-stationary PDE rollout prediction | E3 8D controller | MSE0.0139 | 7 | |
| Non-stationary PDE rollout prediction | E1 1D Burgers (test) | MSE7.10e-4 | 7 | |
| Non-stationary PDE rollout prediction | E5 | MSE0.0016 | 7 | |
| Non-stationary PDE rollout prediction | E4 2D Burgers (test) | MSE0.0018 | 7 |