Compositional Meta-Learning for Mitigating Task Heterogeneity in Physics-Informed Neural Networks
About
Physics-informed neural networks (PINNs) approximate solutions of partial differential equations (PDEs) by embedding physical laws into the loss function. In parameterized PDE families, variations in coefficients or boundary/initial conditions define distinct tasks. This makes training individual PINNs for each task computationally prohibitive, while cross-task transfer can be sensitive to task heterogeneity. While meta-learning can reduce retraining cost, existing methods often rely on a single global initialization and may suffer from negative transfer, particularly under feature-scarce coordinate inputs and limited training-task availability. We propose the Learning-Affinity Adaptive Modular Physics-Informed Neural Network (LAM-PINN), a compositional framework that leverages task-specific learning dynamics. LAM-PINN combines PDE parameters with learning-affinity metrics from brief transfer sessions to construct a task representation and cluster tasks even with coordinate-only inputs. It decomposes the model into cluster-specialized subnetworks and a shared meta network, and learns routing weights to selectively reuse modules instead of relying on a single global initialization. Across three PDE benchmarks, LAM-PINN achieves an average 19.7-fold reduction in mean squared error (MSE) on unseen tasks using only 10% of the training iterations required by conventional PINNs. These results indicate its effectiveness for generalization to unseen configurations within bounded design spaces of parameterized PDE families in resource-constrained engineering settings.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Partial Differential Equation Solving | Helmholtz PDE Family 10 unseen tasks | Average MSE (10 Tasks)0.145 | 9 | |
| Partial Differential Equation Solving | Burgers' PDE Family 10 unseen tasks | Average MSE (10 Tasks)0.0588 | 9 | |
| Partial Differential Equation Solving | Linear Elasticity PDE Family 10 unseen tasks | Average MSE (10 Tasks)0.0011 | 9 | |
| Solving 3D Helmholtz Equation | 3D Helmholtz Equation | MSE0.004 | 8 | |
| Solving Linear Elasticity for a Plate with a Circular Hole | Linear Elasticity Plate with a Circular Hole | MSE0.0703 | 8 |