Latent Generative Solvers for Generalizable Long-Term Physics Simulation
About
Reliable physics simulation demands two capabilities that today's neural PDE solvers do not deliver together: generalization across heterogeneous PDE families, and stability under long autoregressive rollouts. Deterministic operators accumulate error geometrically, while existing probabilistic solvers are confined to a single PDE family or short horizons. We close this gap with the \textbf{Latent Generative Solver} (LGS), three coupled components: (i) a Physics VAE (PhyVAE) compressing twelve PDE families into a shared latent manifold; (ii) a Pyramidal Flow-Forcing Transformer (PFlowFT) that generates the next latent by flow matching, conditioned on a per-trajectory context updated on the model's own predictions; and (iii) input noising during training, for which we derive a sufficient-condition contraction bound explaining the observed long-horizon stability. Pretrained on a 2.5\,M-trajectory, 16-system corpus at $128^2$, LGS matches the strongest deterministic baseline at one step, wins on 15/16 systems at both 5- and 10-step rollout, cuts 20-step L2RE from $56.1\%$ to $\mathbf{30.2\%}$, and uses $\mathbf{13}$--$\mathbf{77\times}$ less recurrent dynamics-step compute. It also adapts efficiently to a $256^2$ Kolmogorov flow held out from the pretraining corpus, dropping 1-step L2RE from $0.398$ to $0.129$ in five finetune epochs against U-AFNO's $0.653{\to}0.343$.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| PDE Simulation | FNO V3 | L2RE (%)1.22 | 10 | |
| PDE Simulation | FNO V5 | L2RE (%)4.74 | 10 | |
| PDE Simulation | FNO V4 | L2 Relative Error (%)8.77 | 10 | |
| PDE Simulation | PA-NSC | L2RE (%)0.0435 | 5 | |
| PDE Simulation | W-RB | L2RE (%)6.73 | 5 | |
| PDE Simulation | W-TR | L2RE (%)4.95 | 5 | |
| PDE Simulation | PA-NS | L2RE (%)16.6 | 5 | |
| PDE Simulation | PA-SWE | L2RE (%)8.18 | 5 | |
| PDE Simulation | W-AM | L2RE (%)4.41 | 5 | |
| PDE Simulation | W-GS | L2 Relative Error (%)3.8 | 5 |