Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Spherical Fourier Neural Operators: Learning Stable Dynamics on the Sphere

About

Fourier Neural Operators (FNOs) have proven to be an efficient and effective method for resolution-independent operator learning in a broad variety of application areas across scientific machine learning. A key reason for their success is their ability to accurately model long-range dependencies in spatio-temporal data by learning global convolutions in a computationally efficient manner. To this end, FNOs rely on the discrete Fourier transform (DFT), however, DFTs cause visual and spectral artifacts as well as pronounced dissipation when learning operators in spherical coordinates since they incorrectly assume a flat geometry. To overcome this limitation, we generalize FNOs on the sphere, introducing Spherical FNOs (SFNOs) for learning operators on spherical geometries. We apply SFNOs to forecasting atmospheric dynamics, and demonstrate stable auto\-regressive rollouts for a year of simulated time (1,460 steps), while retaining physically plausible dynamics. The SFNO has important implications for machine learning-based simulation of climate dynamics that could eventually help accelerate our response to climate change.

Boris Bonev, Thorsten Kurth, Christian Hundt, Jaideep Pathak, Maximilian Baust, Karthik Kashinath, Anima Anandkumar• 2023

Related benchmarks

TaskDatasetResultRank
Weather forecastingWeatherBench 3 Day Forecast
Average ACC73.2
9
Weather forecastingWeatherBench 3 Day Forecast
MSE (2T)9.59
6
Weather forecastingWeatherBench 5 Day Forecast
MSE (2T)13.9
6
Weather forecastingWeatherBench 5 Day Forecast horizon
ACC (2T)87.7
6
Weather forecastingWeatherBench 1 Day Forecast
MSE (2T)4.82
6
Weather forecastingWeatherBench 1 Day Forecast horizon
ACC (2T)95.6
6
Super-ResolutionERA5 global surface temperatures--
6
Super-ResolutionERA5 V wind [m/s]
Quadrature-weighted RMSE0.78
5
Fiber Orientation Distribution predictionHCP White matter
Accuracy89.95
5
Fiber Orientation Distribution predictionHCP Whole brain
Accuracy83.34
5
Showing 10 of 17 rows

Other info

Follow for update