Stochastic Dimension Implicit Functional Projections for Global Integral Conservation in High-Dimensional PINNs
About
Enforcing prescribed global integral constraints in mesh-free neural PDE solvers is challenging in high-dimensional domains. Existing projection methods for spatial integrals are often tied to fixed grids or uniform quadrature, which can conflict with randomly sampled physics-informed neural networks (PINNs) and scale poorly with dimension. High-order differential operators also increase reverse-mode automatic differentiation memory costs. We propose Stochastic Dimension Implicit Functional Projection (SDIFP), a quadrature-level framework for enforcing prescribed first and second spatial moments. SDIFP replaces tensor-product nodal projection by a global affine correction of the neural-network output, with two scalar coefficients determined from a weighted quadrature rule. Under positive target variance and nonzero empirical raw variance, this correction is the nearest-point projection, in the weighted quadrature norm, onto the empirical two-moment constraint set. Thus, the prescribed moments are exact for the selected quadrature rule, while continuum errors are quadrature errors of the corrected field. For decomposable high-dimensional linear operators, SDIFP combines affine moment correction with stochastic operator-subset sampling. With independent residual and derivative sampling and conditionally unbiased coefficient-gradient estimation, the resulting estimator is unbiased for the specified quadrature-based residual objective; the shared-subset fast mode is biased in general. SDIFP avoids tensor-product quadrature for moment enforcement, separates forward quadrature evaluation from the reverse-mode graph, and retains pointwise inference efficiency once the affine coefficients are fixed or precomputed.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Conservation Error Estimation | Advection equation 1D | Momentum Error1.56 | 8 | |
| Conservation Error Estimation | 1D wave equation | Momentum Error1.34 | 8 | |
| Conservation Error Estimation | 2D Advection equation | Momentum Conservation Error1.02 | 8 | |
| Conservation Error Estimation | 2D Reaction-Diffusion equation | Momentum Error1.07 | 8 | |
| Conservation Error Estimation | 2D Wave equation | Momentum Error1.56 | 8 | |
| Conservation Error Estimation | 3D Reaction-Diffusion equation | Momentum Conservation Error1.03 | 8 | |
| Conservation Error Estimation | 3D KdV equation | Momentum Conservation Error1.25 | 8 | |
| Conservation Error Estimation | 1D Reaction-Diffusion equation | Momentum Conservation Error2.4 | 8 | |
| Conservation Error Estimation | 2D KdV equation | Momentum Conservation Error3.66 | 8 | |
| Conservation Error Estimation | 3D Wave equation | Momentum Error4.66 | 8 |