Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Improving Spatio-Temporal Residual Error Propagation by Mitigating Over-Squashing

About

Residual error propagation remains a fundamental problem in recurrent models, where small prediction inaccuracies compound over time and degrade long-horizon performance. Accurately modeling the correlation structure of such residuals is critical for reliable uncertainty quantification in probabilistic multivariate timeseries forecasting. While recent time-series deep models efficiently parametrize time-varying contemporaneous correlations, they often assume temporal independence of errors and neglect spatial correlation across the observed network. In this paper, we introduce Teger, a structured uncertainty module that overcomes the spa- tial and temporal limitations of error-correlated autoregressive forecasting. Teger proposes a spatial curvature-aware graph rewiring mechanism explicitly strengthening information-bottleneck edges identified by discrete Forman curvature. The component is integrated into a low-rank-plus-diagonal covariance head, preserving tractable inference via the Woodbury identity. Teger is backbone-agnostic, requiring only the latent state produced by any autoregressive encoder. We provide theoretical evidence of Teger, and experimentally evaluate it on LSTM, Transformer, and xLSTM backbones across four real-world spatio-temporal datasets, showing consistent improvement in Continuous Ranked Probability Score (CRPS). We further provide a formal theoretical analysis connecting curvature-aware rewiring to (i) oversquashing alleviation, (ii) improved spectral connectivity, (iii) reduced effective resistance, and (iv) improved covariance calibration bounds

Seyed Mohamad Moghadas, Esther Rodrigo Bonet, Bruno Cornelis, Adrian Munteanu• 2026

Related benchmarks

TaskDatasetResultRank
Spatio-temporal forecastingPeMS07 60 min 12-step
CRPSsum0.0891
17
Spatio-temporal forecastingPeMS03 15 min 3-step
CRPSsum0.0292
16
Spatio-temporal forecastingPeMS03 30 min 6-step
CRPSsum0.0305
16
Spatio-temporal forecastingPeMS03 60 min 12-step
CRPSsum0.0316
16
Spatio-temporal forecastingPeMS04 15 min 3-step
CRPSsum0.0112
16
Spatio-temporal forecastingPeMS04 30 min 6-step
CRPSsum0.012
16
Spatio-temporal forecastingPeMS04 60 min 12-step
CRPSsum0.0128
16
Spatio-temporal forecastingPeMS07 15 min 3-step
CRPSsum0.0864
16
Spatio-temporal forecastingPeMS07 30 min 6-step
CRPSsum0.0878
16
Spatio-temporal forecastingBrussels 15 min 3-step
CRPSsum0.0591
16
Showing 10 of 12 rows

Other info

Follow for update