Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasters

About

Foundation models have emerged as a promising approach in time series forecasting (TSF). Existing approaches either repurpose large language models (LLMs) or build large-scale time series datasets to develop TSF foundation models for universal forecasting. However, these methods face challenges due to the severe cross-domain gap or in-domain heterogeneity. This paper explores a new road to building a TSF foundation model from rich, high-quality natural images. Our key insight is that a visual masked autoencoder, pre-trained on the ImageNet dataset, can naturally be a numeric series forecaster. By reformulating TSF as an image reconstruction task, we bridge the gap between image pre-training and TSF downstream tasks. Surprisingly, without further adaptation in the time series domain, the proposed VisionTS could achieve better zero-shot forecast performance than existing TSF foundation models. With fine-tuning for one epoch, VisionTS could further improve the forecasting and achieve state-of-the-art performance in most cases. Extensive experiments reveal intrinsic similarities between images and real-world time series, suggesting that visual models may offer a "free lunch" for TSF and highlight the potential for future cross-modality research. Our code is publicly available at https://github.com/Keytoyze/VisionTS.

Mouxiang Chen, Lefei Shen, Zhuo Li, Xiaoyun Joy Wang, Jianling Sun, Chenghao Liu• 2024

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingETTh2
MSE0.365
561
Time Series ForecastingWeather
MSE0.303
295
Short-term forecastingEPF PJM
MSE0.251
33
Short-term forecastingEPF BE
MSE0.679
33
Short-term forecastingEPF NP
MSE0.51
22
Short-term forecastingEPF FR
MSE0.625
22
Short-term forecastingEPF DE
MSE0.961
22
ForecastingTFB Quarterly
msMAPE17.121
19
Time Series ForecastingTFB Yearly
MASE3.441
19
Time Series ForecastingTFB Daily
MASE1.165
19
Showing 10 of 48 rows

Other info

Follow for update