Gradient-flow SDEs have unique transient population dynamics
About
Identifying the drift and diffusion of an SDE from its population dynamics is a notoriously challenging task. Researchers in machine learning and single-cell biology have only been able to prove a partial identifiability result: for potential-driven SDEs, the gradient-flow drift can be identified from temporal marginals if the Brownian diffusivity is already known. Existing methods therefore assume that the diffusivity is known a priori, despite it being unknown in practice. We dispel the need for this assumption by providing a complete characterization of identifiability: the gradient-flow drift and Brownian diffusivity are jointly identifiable from temporal marginals if and only if the process is observed outside of equilibrium. Given this fundamental result, we propose nn-APPEX, the first Schrodinger Bridge-based inference method that can simultaneously learn the drift and diffusion of a gradient-flow SDE solely from observed marginals. Extensive experiments show that nn-APPEX's ability to adjust its diffusion estimate enables accurate inference, while previous Schrodinger Bridge methods obtain biased drift estimates due to their assumed, and likely incorrect, diffusion.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Gradient flow dynamics marginal prediction | Gradient flow SDEs Paired | Average W1 Distance0.131 | 4 | |
| Gradient flow dynamics marginal prediction | Gradient flow SDEs Paired (train) | Average W1 Distance0.08 | 4 | |
| Gradient flow dynamics marginal prediction | Gradient flow SDEs Unpaired (train) | Average W1 Distance0.102 | 4 | |
| Gradient flow dynamics marginal prediction | Gradient flow SDEs Unpaired | Average W1 Distance0.26 | 4 | |
| Population Dynamics Modeling | Boids (train) | W12.467 | 4 | |
| Population Dynamics Modeling | Boids (forecast) | W1 Error3.078 | 4 |