Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Generative Model Proposal based Particle Filtering for Data Assimilation

About

Data assimilation models state dynamics conditioned on sequential observations, and has wide-ranging scientific applications. In the filtering setting, the goal is to model the posterior over the current state given all observations so far. Classical solutions typically make simplifying distributional or functional assumptions, e.g., linear-Gaussian systems, which can be inaccurate in many scenarios. In principle, particle filters (PFs) remove these assumptions, yet often collapse in high dimensions. Recent generative approaches learn conditional state transitions, but without principled Bayesian updates they do not recover the correct filtering posterior and can accumulate error over long horizons. In this work, we introduce Flow Proposal Particle Filters (FPPF), which learn a conditional generative model based proposal approximating the variance-minimizing optimal proposal for particle propagation. Conditioning on observations steers particles toward high-likelihood regions before weighting, reducing weight variance and delaying degeneracy. Since our proposal admits tractable likelihood evaluation, FPPF computes accurate importance weights and retains a Bayesian update step. We further extend FPPF to high-dimensional problems through localization strategies, adressing another standard PF failure mode. Extensive experiments on a variety of dynamical systems show that FPPF outperforms statistical baselines and other generative methods in non-linear, non-Gaussian, and high-dimensional regimes.

Chandni Nagda, Mayank Shrivastava, Gudrun Thorkelsdottir, Gan Zhang, Morteza Mardani, Arindam Banerjee• 2026

Related benchmarks

TaskDatasetResultRank
State estimationLorenz-96 quadratic capped observation operator (test)
RMSE0.201
48
State estimationLorenz-96 arctan observation operator
RMSE0.189
48
FilteringLorenz-96
RMSE0.669
24
FilteringLorenz-96 Arctangent Observation Operator
RMSE0.287
24
FilteringKuramoto-Sivashinsky L=16π, min(z^4, 10)
RMSE0.11
8
FilteringKuramoto-Sivashinsky L=32π, min(z^4, 10)
RMSE1.15
8
FilteringKuramoto-Sivashinsky L=16π, arctan
RMSE0.09
8
FilteringKuramoto-Sivashinsky L=32π arctan
RMSE0.19
8
State estimationLorenz-63 1000 length 50 trajectories
RMSE2.7504
5
Showing 9 of 9 rows

Other info

Follow for update