Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Disentangled Parameter-Efficient Linear Model for Long-Term Time Series Forecasting

About

Long-term Time Series Forecasting (LTSF) is crucial across various domains, but complex deep models like Transformers are often prone to overfitting on extended sequences. Linear Fully Connected models have emerged as a powerful alternative, achieving competitive results with fewer parameters. However, their reliance on a single, monolithic weight matrix leads to quadratic parameter redundancy and an entanglement of temporal and frequential properties. To address this, we propose DiPE-Linear, a novel model that disentangles this monolithic mapping into a sequence of specialized, parameter-efficient modules. DiPE-Linear features three core components: Static Frequential Attention to prioritize critical frequencies, Static Time Attention to focus on key time steps, and Independent Frequential Mapping to independently process frequency components. A Low-rank Weight Sharing policy further enhances efficiency for multivariate data. This disentangled architecture collectively reduces parameter complexity from quadratic to linear and computational complexity to log-linear. Experiments on real-world datasets show that DiPE-Linear delivers state-of-the-art performance with significantly fewer parameters, establishing a new and highly efficient baseline for LTSF. Our code is available at https://github.com/wintertee/DiPE-Linear/

Yuang Zhao, Tianyu Li, Jiadong Chen, Shenrong Ye, Fuxin Jiang, Xiaofeng Gao• 2024

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingETTh1
MSE0.369
601
Time Series ForecastingETTh2
MSE0.275
438
Time Series ForecastingETTm2
MSE0.162
382
Time Series ForecastingETTm1
MSE0.309
334
Time Series ForecastingWeather
MSE0.142
223
Time Series ForecastingECL
MSE0.132
183
Time Series ForecastingElectricity
MSE0.132
161
Time Series ForecastingIllness
MSE2.053
42
Time Series ForecastingFaaS
MSE0.28
20
Time Series ForecastingIaaS
MSE0.789
20
Showing 10 of 11 rows

Other info

Code

Follow for update