VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasters
About
Foundation models have emerged as a promising approach in time series forecasting (TSF). Existing approaches either repurpose large language models (LLMs) or build large-scale time series datasets to develop TSF foundation models for universal forecasting. However, these methods face challenges due to the severe cross-domain gap or in-domain heterogeneity. This paper explores a new road to building a TSF foundation model from rich, high-quality natural images. Our key insight is that a visual masked autoencoder, pre-trained on the ImageNet dataset, can naturally be a numeric series forecaster. By reformulating TSF as an image reconstruction task, we bridge the gap between image pre-training and TSF downstream tasks. Surprisingly, without further adaptation in the time series domain, the proposed VisionTS could achieve better zero-shot forecast performance than existing TSF foundation models. With fine-tuning for one epoch, VisionTS could further improve the forecasting and achieve state-of-the-art performance in most cases. Extensive experiments reveal intrinsic similarities between images and real-world time series, suggesting that visual models may offer a "free lunch" for TSF and highlight the potential for future cross-modality research. Our code is publicly available at https://github.com/Keytoyze/VisionTS.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Time Series Forecasting | ETTh2 | MSE0.288 | 796 | |
| Long-term time-series forecasting | ETTh1 | MAE0.414 | 575 | |
| Long-term time-series forecasting | Weather | MSE0.269 | 525 | |
| Time Series Forecasting | Weather | MSE0.303 | 497 | |
| Long-term time-series forecasting | ETTm1 | MSE0.374 | 461 | |
| Long-term time-series forecasting | ETTm2 | MSE0.282 | 455 | |
| Long-term time-series forecasting | Traffic | MSE0.413 | 427 | |
| Time Series Forecasting | ETTm1 | MSE0.373 | 363 | |
| Time Series Forecasting | Electricity | MSE0.159 | 237 | |
| Long-term time-series forecasting | ECL | MSE0.207 | 163 |