Generalizing to New Physical Systems via Context-Informed Dynamics Model
About
Data-driven approaches to modeling physical systems fail to generalize to unseen systems that share the same general dynamics with the learning domain, but correspond to different physical contexts. We propose a new framework for this key problem, context-informed dynamics adaptation (CoDA), which takes into account the distributional shift across systems for fast and efficient adaptation to new dynamics. CoDA leverages multiple environments, each associated to a different dynamic, and learns to condition the dynamics model on contextual parameters, specific to each environment. The conditioning is performed via a hypernetwork, learned jointly with a context vector from observed data. The proposed formulation constrains the search hypothesis space to foster fast adaptation and better generalization across environments. We theoretically motivate our approach and show state-of-the-art generalization results on a set of nonlinear dynamics, representative of a variety of application domains. We also show, on these systems, that new system parameters can be inferred from context vectors with minimal supervision. Code is available at https://github.com/yuan-yin/CoDA .
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| PDE Dynamics Forecasting | Navier-Stokes (ID) | nMSE0.431 | 11 | |
| PDE Dynamics Forecasting | Navier-Stokes (NS) OOD | nMSE0.914 | 11 | |
| PDE Dynamics Forecasting | Heat Convection (HC) (OOD) | nMSE2.37 | 7 | |
| PDE Dynamics Forecasting | DR (ID) | nMSE0.34 | 7 | |
| PDE Dynamics Forecasting | Diffusion-Reaction (DR) (OOD) | nMSE0.605 | 7 | |
| PDE Dynamics Forecasting | Heat Convection (ID) | NMSE1.16 | 7 | |
| PDE Dynamics Forecasting | Burgers (ID) | nMSE0.872 | 7 | |
| PDE Dynamics Forecasting | Burgers OOD | nMSE0.922 | 7 | |
| Forecasting | ODE-governed pendulum dynamics (OOD) | nMSE5.31 | 3 |