What If We Let Forecasting Forget? A Sparse Bottleneck for Cross-Variable Dependencies
About
Multivariate time series forecasting is critical in many real-world systems, and thus modeling cross-channel dependencies is essential. Although existing methods improve overall accuracy by enhancing representations and cross-channel interactions, it remains challenging to reliably capture inter-variable dependencies under specific conditions. We observe that dependencies in real data are often state-dependent and noisy; in such cases, dense interactions can amplify spurious correlations and lead to representation over-smoothing, which may yield unreliable predictions in certain scenarios. Motivated by this, we propose MS-FLOW, a sparse-bottleneck framework that explicitly models inter-variable interaction as capacity-limited information flow. Specifically, MS-FLOW replaces fully connected communication with selective sparse routing, retaining only a few critical dependency paths and injecting cross-variable signals under a strict communication budget, thereby suppressing redundant connections and spurious-correlation propagation. Extensive experiments demonstrate that MS-FLOW learns more reliable multivariate correlations, achieving state-of-the-art forecasting accuracy on 12 real-world benchmarks while producing fewer yet more reliable dependencies, shifting multivariate forecasting from "more interaction" to "more effective interaction".
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Long-term forecasting | ETTm1 | MSE0.368 | 422 | |
| Long-term forecasting | ETTh1 | MSE0.367 | 409 | |
| Long-term forecasting | ETTm2 | MSE0.264 | 350 | |
| Long-term forecasting | ETTh2 | MSE0.306 | 310 | |
| Long-term time-series forecasting | Solar Energy | MSE0.173 | 126 | |
| Short-term forecasting | PeMS03 | MAE0.183 | 65 | |
| Short-term forecasting | PeMS07 | MAE0.161 | 62 | |
| Short-term forecasting | PeMS04 | MSE0.081 | 58 | |
| Short-term forecasting | PeMS08 | MSE0.088 | 58 | |
| Long-term forecasting | Traffic | MSE0.44 | 39 |