Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WaveSFNet: A Wavelet-Based Codec and Spatial--Frequency Dual-Domain Gating Network for Spatiotemporal Prediction

About

Spatiotemporal predictive learning aims to forecast future frames from historical observations in an unsupervised manner, and is critical to a wide range of applications. The key challenge is to model long-range dynamics while preserving high-frequency details for sharp multi-step predictions. Existing efficient recurrent-free frameworks typically rely on strided convolutions or pooling for sampling, which tends to discard textures and boundaries, while purely spatial operators often struggle to balance local interactions with global propagation. To address these issues, we propose WaveSFNet, an efficient framework that unifies a wavelet-based codec with a spatial--frequency dual-domain gated spatiotemporal translator. The wavelet-based codec preserves high-frequency subband cues during downsampling and reconstruction. Meanwhile, the translator first injects adjacent-frame differences to explicitly enhance dynamic information, and then performs dual-domain gated fusion between large-kernel spatial local modeling and frequency-domain global modulation, together with gated channel interaction for cross-channel feature exchange. Extensive experiments demonstrate that WaveSFNet achieves competitive prediction accuracy on Moving MNIST, TaxiBJ, and WeatherBench, while maintaining low computational complexity. Our code is available at https://github.com/fhjdqaq/WaveSFNet.

Xinyong Cai, Runming Xie, Hu Chen, Yuankai Wu• 2026

Related benchmarks

TaskDatasetResultRank
Video PredictionMoving MNIST
SSIM0.966
83
Spatio-temporal forecastingTaxiBJ
MSE0.287
45
Multi-variable Weather ForecastingWeatherBench multi-variable forecasting R, T, U, and V
MSE96.141
13
Single-variable Weather ForecastingWeatherBench T2M
MSE1.0458
10
Single-variable Weather ForecastingWeatherBench TCC
MAE0.1459
10
Single-variable Weather ForecastingWeatherBench R
MAE3.7363
10
Single-variable Weather ForecastingWeatherBench UV10
MSE1.4601
9
Showing 7 of 7 rows

Other info

Follow for update