Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

What If We Let Forecasting Forget? A Sparse Bottleneck for Cross-Variable Dependencies

About

Multivariate time series forecasting is critical in many real-world systems, and thus modeling cross-channel dependencies is essential. Although existing methods improve overall accuracy by enhancing representations and cross-channel interactions, it remains challenging to reliably capture inter-variable dependencies under specific conditions. We observe that dependencies in real data are often state-dependent and noisy; in such cases, dense interactions can amplify spurious correlations and lead to representation over-smoothing, which may yield unreliable predictions in certain scenarios. Motivated by this, we propose MS-FLOW, a sparse-bottleneck framework that explicitly models inter-variable interaction as capacity-limited information flow. Specifically, MS-FLOW replaces fully connected communication with selective sparse routing, retaining only a few critical dependency paths and injecting cross-variable signals under a strict communication budget, thereby suppressing redundant connections and spurious-correlation propagation. Extensive experiments demonstrate that MS-FLOW learns more reliable multivariate correlations, achieving state-of-the-art forecasting accuracy on 12 real-world benchmarks while producing fewer yet more reliable dependencies, shifting multivariate forecasting from "more interaction" to "more effective interaction".

Fan Zhang, Shiming Fan, Hua Wang• 2026

Related benchmarks

TaskDatasetResultRank
Long-term forecastingETTm1
MSE0.368
422
Long-term forecastingETTh1
MSE0.367
409
Long-term forecastingETTm2
MSE0.264
350
Long-term forecastingETTh2
MSE0.306
310
Long-term time-series forecastingSolar Energy
MSE0.173
126
Short-term forecastingPeMS03
MAE0.183
65
Short-term forecastingPeMS07
MAE0.161
62
Short-term forecastingPeMS04
MSE0.081
58
Short-term forecastingPeMS08
MSE0.088
58
Long-term forecastingTraffic
MSE0.44
39
Showing 10 of 10 rows

Other info

Follow for update