SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameters
About
This paper introduces SparseTSF, a novel, extremely lightweight model for Long-term Time Series Forecasting (LTSF), designed to address the challenges of modeling complex temporal dependencies over extended horizons with minimal computational resources. At the heart of SparseTSF lies the Cross-Period Sparse Forecasting technique, which simplifies the forecasting task by decoupling the periodicity and trend in time series data. This technique involves downsampling the original sequences to focus on cross-period trend prediction, effectively extracting periodic features while minimizing the model's complexity and parameter count. Based on this technique, the SparseTSF model uses fewer than *1k* parameters to achieve competitive or superior performance compared to state-of-the-art models. Furthermore, SparseTSF showcases remarkable generalization capabilities, making it well-suited for scenarios with limited computational resources, small samples, or low-quality data. The code is publicly available at this repository: https://github.com/lss-1138/SparseTSF.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Long-term time-series forecasting | ETTh1 | MAE0.388 | 351 | |
| Long-term time-series forecasting | Weather | MSE0.172 | 348 | |
| Multivariate long-term forecasting | ETTh1 | MSE0.362 | 344 | |
| Long-term time-series forecasting | ETTh2 | MSE0.344 | 327 | |
| Multivariate long-term series forecasting | ETTh2 | MSE0.294 | 319 | |
| Long-term time-series forecasting | ETTm2 | MSE0.165 | 305 | |
| Long-term time-series forecasting | ETTm1 | MSE0.314 | 295 | |
| Long-term time-series forecasting | Traffic | MSE0.412 | 278 | |
| Multivariate long-term series forecasting | ETTm1 | MSE0.314 | 257 | |
| Long-term time-series forecasting | ETTh1 (test) | MSE0.373 | 221 |