Disentangled Parameter-Efficient Linear Model for Long-Term Time Series Forecasting
About
Long-term Time Series Forecasting (LTSF) is crucial across various domains, but complex deep models like Transformers are often prone to overfitting on extended sequences. Linear Fully Connected models have emerged as a powerful alternative, achieving competitive results with fewer parameters. However, their reliance on a single, monolithic weight matrix leads to quadratic parameter redundancy and an entanglement of temporal and frequential properties. To address this, we propose DiPE-Linear, a novel model that disentangles this monolithic mapping into a sequence of specialized, parameter-efficient modules. DiPE-Linear features three core components: Static Frequential Attention to prioritize critical frequencies, Static Time Attention to focus on key time steps, and Independent Frequential Mapping to independently process frequency components. A Low-rank Weight Sharing policy further enhances efficiency for multivariate data. This disentangled architecture collectively reduces parameter complexity from quadratic to linear and computational complexity to log-linear. Experiments on real-world datasets show that DiPE-Linear delivers state-of-the-art performance with significantly fewer parameters, establishing a new and highly efficient baseline for LTSF. Our code is available at https://github.com/wintertee/DiPE-Linear/
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Time Series Forecasting | ETTh1 | MSE0.369 | 601 | |
| Time Series Forecasting | ETTh2 | MSE0.275 | 438 | |
| Time Series Forecasting | ETTm2 | MSE0.162 | 382 | |
| Time Series Forecasting | ETTm1 | MSE0.309 | 334 | |
| Time Series Forecasting | Weather | MSE0.142 | 223 | |
| Time Series Forecasting | ECL | MSE0.132 | 183 | |
| Time Series Forecasting | Electricity | MSE0.132 | 161 | |
| Time Series Forecasting | Illness | MSE2.053 | 42 | |
| Time Series Forecasting | FaaS | MSE0.28 | 20 | |
| Time Series Forecasting | IaaS | MSE0.789 | 20 |