Stabilizing Physics-Informed Consistency Models via Structure-Preserving Training
About
We propose a physics-informed consistency modeling framework for solving partial differential equations (PDEs) via fast, few-step generative inference. We identify a key stability challenge in physics-constrained consistency training, where PDE residuals can drive the model toward trivial or degenerate solutions, degrading the learned data distribution. To address this, we introduce a structure-preserving two-stage training strategy that decouples distribution learning from physics enforcement by freezing the coefficient decoder during physics-informed fine-tuning. We further propose a two-step residual objective that enforces physical consistency on refined, structurally valid generative trajectories rather than noisy single-step predictions. The resulting framework enables stable, high-fidelity inference for both unconditional generation and forward problems. We demonstrate that forward solutions can be obtained via a projection-based zero-shot inpainting procedure, achieving consistent accuracy of diffusion baselines with orders of magnitude reduction in computational cost.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Forward PDE solving | Darcy flow (test) | Relative H1 Error0.105 | 9 | |
| Forward PDE solving | Poisson (test) | Relative H1 Error0.181 | 9 | |
| Forward PDE solving | Helmholtz (test) | Relative H1 Error0.233 | 9 | |
| Conditional source inference | Poisson 256 samples (test) | Relative L2 Error0.399 | 6 | |
| Conditional source inference | Helmholtz 256 samples (test) | Relative L2 Error0.381 | 6 | |
| Unconditional Sampling | Darcy flow (test) | Normalized PDE Residual (||R||₂ · h²)0.02 | 3 | |
| Unconditional Sampling | Poisson (test) | Normalized PDE Residual0.0113 | 3 | |
| Unconditional Sampling | Helmholtz (test) | PDE Residual (Normalized)0.0111 | 3 | |
| PDE Solution Generation | PDE Solutions | NFE64 | 2 |