Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PMDformer: Patch-Mean Decoupling Information Transformer for Long-term Forecasting

About

Long-term time series forecasting (LTSF) plays a crucial role in fields such as energy management, finance, and traffic prediction. Transformer-based models have adopted patch-based strategies to capture long-range dependencies, but accurately modeling shape similarities across patches and variables remains challenging due to scale differences. To address this, we introduce patch-mean decoupling (PMD), which separates the trend and residual shape information by subtracting the mean of each patch, preserving the original structure and ensuring that the attention mechanism captures true shape similarities. Futhermore, to more effectively model long-range dependencies and capture cross-variable relationships, we propose Trend Restoration Attention (TRA) and Proximal Variable Attention (PVA). The former module reintegrates the decoupled trend from PMD while calculating attention output. And the latter focuses cross-variable attention on the most relevant, recent time segments to avoid overfitting on outdated correlations. Combining these components, we propose PMDformer, a model designed to effectively capture shape similarity in long-term forecasting scenarios. Extensive experiments indicate that PMDformer outperforms existing state-of-the-art methods in stability and accuracy across multiple LTSF benchmarks. The code is available at https://github.com/aohu1105/PMDformer.

Ao Hu, Liangjian Wen, Jiang Duan, Yong Dai, He Yan, Dongkai Wang, Jun Wang, Yukun Zhang, Ruoxi Jiang, Zenglin Xu• 2026

Related benchmarks

TaskDatasetResultRank
Multivariate long-term forecastingETTm1 v1 (test)
MSE0.279
31
Multivariate long-term forecastingWeather v1 (test)
MSE0.141
22
Multivariate long-term forecastingETTm2 v1 (test)
MSE0.155
21
Multivariate long-term forecastingETTh2 v1 (test)
MSE0.269
21
Multivariate long-term forecastingETTh1 v1 (test)
MSE0.356
21
Multivariable long-term time series forecastingECL v1 (test)
MSE0.122
12
Multivariate long-term forecastingTraffic v1 (test)
MSE0.338
7
Multivariable long-term time series forecastingSolar-Energy v1 (test)
MSE0.16
3
Showing 8 of 8 rows

Other info

Follow for update