Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasters

About

Foundation models have emerged as a promising approach in time series forecasting (TSF). Existing approaches either repurpose large language models (LLMs) or build large-scale time series datasets to develop TSF foundation models for universal forecasting. However, these methods face challenges due to the severe cross-domain gap or in-domain heterogeneity. This paper explores a new road to building a TSF foundation model from rich, high-quality natural images. Our key insight is that a visual masked autoencoder, pre-trained on the ImageNet dataset, can naturally be a numeric series forecaster. By reformulating TSF as an image reconstruction task, we bridge the gap between image pre-training and TSF downstream tasks. Surprisingly, without further adaptation in the time series domain, the proposed VisionTS could achieve better zero-shot forecast performance than existing TSF foundation models. With fine-tuning for one epoch, VisionTS could further improve the forecasting and achieve state-of-the-art performance in most cases. Extensive experiments reveal intrinsic similarities between images and real-world time series, suggesting that visual models may offer a "free lunch" for TSF and highlight the potential for future cross-modality research. Our code is publicly available at https://github.com/Keytoyze/VisionTS.

Mouxiang Chen, Lefei Shen, Zhuo Li, Xiaoyun Joy Wang, Jianling Sun, Chenghao Liu• 2024

Related benchmarks

TaskDatasetResultRank
ForecastingTFB Quarterly
msMAPE17.121
19
Time Series ForecastingTFB Yearly
MASE3.441
19
Time Series ForecastingTFB Daily
MASE1.165
19
Time Series ForecastingTFB Other
MASE3.541
19
Time Series ForecastingTFB Quarterly
MASE1.849
19
Time Series ForecastingTFB Weekly
MASE1.628
19
ForecastingTFB Weekly
msMAPE19.359
19
Time Series ForecastingTFB Avg
MASE2.167
19
ForecastingTFB Daily
msMAPE22.331
19
ForecastingTFB Other
msMAPE14.666
19
Showing 10 of 42 rows

Other info

Follow for update