Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

FNP: Fourier Neural Processes for Arbitrary-Resolution Data Assimilation

About

Data assimilation is a vital component in modern global medium-range weather forecasting systems to obtain the best estimation of the atmospheric state by combining the short-term forecast and observations. Recently, AI-based data assimilation approaches have attracted increasing attention for their significant advantages over traditional techniques in terms of computational consumption. However, existing AI-based data assimilation methods can only handle observations with a specific resolution, lacking the compatibility and generalization ability to assimilate observations with other resolutions. Considering that complex real-world observations often have different resolutions, we propose the \textit{\textbf{Fourier Neural Processes}} (FNP) for \textit{arbitrary-resolution data assimilation} in this paper. Leveraging the efficiency of the designed modules and flexible structure of neural processes, FNP achieves state-of-the-art results in assimilating observations with varying resolutions, and also exhibits increasing advantages over the counterparts as the resolution and the amount of observations increase. Moreover, our FNP trained on a fixed resolution can directly handle the assimilation of observations with out-of-distribution resolutions and the observational information reconstruction task without additional fine-tuning, demonstrating its excellent generalization ability across data resolutions as well as across tasks.

Kun Chen, Tao Chen, Peng Ye, Hao Chen, Kang Chen, Tao Han, Wanli Ouyang, Lei Bai• 2024

Related benchmarks

TaskDatasetResultRank
Data AssimilationERA5 0.703125° resolution
MSE0.0085
5
Data AssimilationERA5 0.25° resolution
MSE0.0058
5
Information reconstructionERA5
MSE0.0291
5
Data AssimilationERA5 1.40625° resolution
MSE0.0202
4
Showing 4 of 4 rows

Other info

Code

Follow for update