Learning to Advect: A Neural Semi-Lagrangian Architecture for Weather Forecasting
About
Recent machine-learning approaches to weather forecasting often employ a monolithic architecture, where distinct physical mechanisms (advection, transport), diffusion-like mixing, thermodynamic processes, and forcing are represented implicitly within a single large network. This representation is particularly problematic for advection, where long-range transport must be treated with expensive global interaction mechanisms or through deep, stacked convolutional layers. To mitigate this, we present PARADIS, a physics-inspired global weather prediction model that imposes inductive biases on network behavior through a functional decomposition into advection, diffusion, and reaction blocks acting on latent variables. We implement advection through a Neural Semi-Lagrangian operator that performs trajectory-based transport via differentiable interpolation on the sphere, enabling end-to-end learning of both the latent modes to be transported and their characteristic trajectories. Diffusion-like processes are modeled through depthwise-separable spatial mixing, while local source terms and vertical interactions are modeled via pointwise channel interactions, enabling operator-level physical structure. PARADIS provides state-of-the-art forecast skill at a fraction of the training cost. On ERA5-based benchmarks, the 1 degree PARADIS model, with a total training cost of less than a GPU month, meets or exceeds the performance of 0.25 degree traditional and machine-learning baselines, including the ECMWF HRES forecast and DeepMind's GraphCast.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Weather Forecasting (Geopotential) | ERA5 (test) | RMSE (1d)35.4 | 15 | |
| Weather Forecasting (U-component of Wind) | ERA5 (test) | RMSE (1d)0.775 | 15 | |
| Weather Forecasting (V-component of Wind) | ERA5 (test) | RMSE (1d)0.804 | 15 | |
| Weather Forecasting (Specific Humidity) | ERA5 (test) | RMSE Lead Time 1d2.93e-4 | 15 | |
| Weather Forecasting (Temperature) | ERA5 (test) | RMSE (1d)0.41 | 15 | |
| Weather Forecasting (Vertical Velocity) | ERA5 (test) | RMSE (1 day Lead Time)0.022 | 12 | |
| Weather forecasting | ERA5 1-day lead time | Z50039.4 | 5 | |
| Weather forecasting | ERA5 5-day lead time | RMSE z500273 | 5 | |
| Weather forecasting | ERA5 10-day lead time | z500 (Geopotential Height 500hPa)727 | 5 |