Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

VFEM: Visual Feature Empowered Multivariate Time Series Forecasting with Cross-Modal Fusion

About

Large time series foundation models often adopt channel-independent architectures to handle varying data dimensions, but this design ignores crucial cross-channel dependencies. Meanwhile, existing cross-modal methods predominantly rely on textual modalities, leaving the spatial pattern recognition capabilities of vision models underexplored for time series analysis. To address these limitations, we propose VFEM, a cross-modal forecasting model that leverages pre-trained large vision models (LVMs) to capture complex cross-variable patterns. VFEM transforms multivariate time series into visual representations, enabling LVMs to perceive spatial relationships that are not explicitly modeled by channel-independent models. Through a dual-branch architecture, visual and temporal features are independently extracted and then fused via cross-modal attention, allowing complementary information from both modalities to enhance forecasting. By freezing the LVM and training only 7.45% of the total parameters, VFEM achieves competitive performance on multiple benchmarks, offering a new perspective on multivariate time series forecasting.

Yanlong Wang, Hang Yu, Jian Xu, Fei Ma, Hongkang Zhang, Tongtong Feng, Zijian Zhang, Shao-Lun Huang, Danny Dongning Sun, Xiao-Ping Zhang• 2025

Related benchmarks

TaskDatasetResultRank
Long-term forecastingETTh2--
376
Time Series ForecastingECL
MAE0.22
345
ForecastingTraffic
MAE0.251
100
ForecastingETTh1
MAE0.383
78
ForecastingETTm2
MAE0.255
63
ForecastingETTm1
MAE0.343
49
ForecastingWeather
MAE0.201
45
Time Series ForecastingETTh1
MSE (Horizon 96)0.348
9
Time Series ForecastingETTh2
MSE (F=96)0.266
9
Time Series ForecastingETTm1
MSE (F=96)0.291
9
Showing 10 of 14 rows

Other info

Follow for update