CMoS: Rethinking Time Series Prediction Through the Lens of Chunk-wise Spatial Correlations
About
Recent advances in lightweight time series forecasting models suggest the inherent simplicity of time series forecasting tasks. In this paper, we present CMoS, a super-lightweight time series forecasting model. Instead of learning the embedding of the shapes, CMoS directly models the spatial correlations between different time series chunks. Additionally, we introduce a Correlation Mixing technique that enables the model to capture diverse spatial correlations with minimal parameters, and an optional Periodicity Injection technique to ensure faster convergence. Despite utilizing as low as 1% of the lightweight model DLinear's parameters count, experimental results demonstrate that CMoS outperforms existing state-of-the-art models across multiple datasets. Furthermore, the learned weights of CMoS exhibit great interpretability, providing practitioners with valuable insights into temporal structures within specific application scenarios.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Long-term forecasting | ETTm1 | MSE0.292 | 375 | |
| Long-term forecasting | ETTh1 | MSE0.403 | 365 | |
| Long-term forecasting | ETTm2 | MSE0.259 | 310 | |
| Long-term time-series forecasting | ETTh1 (test) | MSE0.403 | 264 | |
| Long-term time-series forecasting | Traffic (test) | MSE0.396 | 149 | |
| Long-term time-series forecasting | Weather (test) | MSE0.22 | 147 | |
| Long-term time-series forecasting | ETTm1 (test) | MSE0.354 | 138 | |
| Long-term time-series forecasting | ETTh2 (test) | MSE0.331 | 135 | |
| Long-term time-series forecasting | ETTm2 (test) | MSE0.259 | 61 | |
| Long-term forecasting | Solar (test) | MSE0.21 | 22 |