Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Latent Autoencoder Ensemble Kalman Filter for Data assimilation

About

The ensemble Kalman filter (EnKF) is widely used for data assimilation in high-dimensional systems, but its performance often deteriorates for strongly nonlinear dynamics due to the structural mismatch between the Kalman update and the underlying system behavior. In this work, we propose a latent autoencoder ensemble Kalman filter (LAE-EnKF) that addresses this limitation by reformulating the assimilation problem in a learned latent space with linear and stable dynamics. The proposed method learns a nonlinear encoder--decoder together with a stable linear latent evolution operator and a consistent latent observation mapping, yielding a closed linear state-space model in the latent coordinates. This construction restores compatibility with the Kalman filtering framework and allows both forecast and analysis steps to be carried out entirely in the latent space. Compared with existing autoencoder-based and latent assimilation approaches that rely on unconstrained nonlinear latent dynamics, the proposed formulation emphasizes structural consistency, stability, and interpretability. We provide a theoretical analysis of learning linear dynamics on low-dimensional manifolds and establish generalization error bounds for the proposed latent model. Numerical experiments on representative nonlinear and chaotic systems demonstrate that the LAE-EnKF yields more accurate and stable assimilation than the standard EnKF and related latent-space methods, while maintaining comparable computational cost and data-driven.

Xin T. Tong, Yanyan Wang, Liang Yan• 2026

Related benchmarks

TaskDatasetResultRank
Data AssimilationExample 2 Advection-diffusion-reaction system
Relative Error (ERel,1:T)7.17
12
Data AssimilationLorenz-96 Delta t = 0.1
Relative RMSE0.1429
11
Data AssimilationLorenz-96 Delta t = 0.2
Relative RMSE0.1531
11
Data Assimilation100-dimensional nonlinear toy dynamical system (test)
Relative Error (1:T)1.4244
10
Showing 4 of 4 rows

Other info

Follow for update