Temporal Patch Shuffle (TPS): Leveraging Patch-Level Shuffling to Boost Generalization and Robustness in Time Series Forecasting
About
Data augmentation is a crucial technique for improving model generalization and robustness, particularly in deep learning models where training data is limited. Although many augmentation methods have been developed for time series classification, most are not directly applicable to time series forecasting due to the need to preserve temporal coherence. In this work, we propose Temporal Patch Shuffle (TPS), a simple and model-agnostic data augmentation method for forecasting that extracts overlapping temporal patches, selectively shuffles a subset of patches using variance-based ordering as a conservative heuristic, and reconstructs the sequence by averaging overlapping regions. This design increases sample diversity while preserving forecast-consistent local temporal structure. We extensively evaluate TPS across nine long-term forecasting datasets using five recent model families (TSMixer, DLinear, PatchTST, TiDE, and LightTS), and across four short-term forecasting datasets using PatchTST, observing consistent performance improvements. Comprehensive ablation studies further demonstrate the effectiveness, robustness, and design rationale of the proposed method.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Long-term forecasting | 9 datasets average | MSE0.445 | 60 | |
| Time-series classification | UCR 30 | Mean Accuracy (UCR 30)80.4 | 21 | |
| Multivariate Time Series Classification | UEA 10 | Accuracy64.3 | 17 | |
| Short-term Traffic Forecasting | PeMS03 short-term traffic (test) | MSE0.104 | 12 | |
| Short-term Traffic Forecasting | PeMS04 short-term traffic (test) | MSE0.125 | 12 | |
| Short-term Traffic Forecasting | PeMS08 short-term traffic (test) | MSE0.135 | 12 | |
| Short-term Traffic Forecasting | PeMS07 short-term traffic (test) | MSE0.105 | 12 | |
| Probabilistic Forecasting | ETTh1 | Pinball Loss0.1727 | 7 | |
| Probabilistic Forecasting | ETTh2 | Pinball Loss0.1636 | 7 | |
| Probabilistic Forecasting | ETTm1 | Pinball Loss0.1547 | 7 |