Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

IPatch: A Multi-Resolution Transformer Architecture for Robust Time-Series Forecasting

About

Accurate forecasting of multivariate time series remains challenging due to the need to capture both short-term fluctuations and long-range temporal dependencies. Transformer-based models have emerged as a powerful approach, but their performance depends critically on the representation of temporal data. Traditional point-wise representations preserve individual time-step information, enabling fine-grained modeling, yet they tend to be computationally expensive and less effective at modeling broader contextual dependencies, limiting their scalability to long sequences. Patch-wise representations aggregate consecutive steps into compact tokens to improve efficiency and model local temporal dynamics, but they often discard fine-grained temporal details that are critical for accurate predictions in volatile or complex time series. We propose IPatch, a multi-resolution Transformer architecture that integrates both point-wise and patch-wise tokens, modeling temporal information at multiple resolutions. Experiments on 7 benchmark datasets demonstrate that IPatch consistently improves forecasting accuracy, robustness to noise, and generalization across various prediction horizons compared to single-representation baselines.

Aymane Harkati, Moncef Garouani, Olivier Teste, Julien Aligon, Mohamed Hamlich• 2026

Related benchmarks

TaskDatasetResultRank
Long-term forecastingETTm1
MSE0.304
375
Long-term forecastingETTh1
MSE0.376
365
Long-term forecastingETTm2
MSE0.17
310
Long-term forecastingETTh2
MSE0.284
266
Long-term forecastingElectricity
MSE0.153
167
Long-term time-series forecastingILI
MSE1.445
102
Showing 6 of 6 rows

Other info

Follow for update