VFEM: Visual Feature Empowered Multivariate Time Series Forecasting with Cross-Modal Fusion
About
Large time series foundation models often adopt channel-independent architectures to handle varying data dimensions, but this design ignores crucial cross-channel dependencies. Meanwhile, existing cross-modal methods predominantly rely on textual modalities, leaving the spatial pattern recognition capabilities of vision models underexplored for time series analysis. To address these limitations, we propose VFEM, a cross-modal forecasting model that leverages pre-trained large vision models (LVMs) to capture complex cross-variable patterns. VFEM transforms multivariate time series into visual representations, enabling LVMs to perceive spatial relationships that are not explicitly modeled by channel-independent models. Through a dual-branch architecture, visual and temporal features are independently extracted and then fused via cross-modal attention, allowing complementary information from both modalities to enhance forecasting. By freezing the LVM and training only 7.45% of the total parameters, VFEM achieves competitive performance on multiple benchmarks, offering a new perspective on multivariate time series forecasting.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Long-term forecasting | ETTh2 | -- | 376 | |
| Time Series Forecasting | ECL | MAE0.22 | 345 | |
| Forecasting | Traffic | MAE0.251 | 100 | |
| Forecasting | ETTh1 | MAE0.383 | 78 | |
| Forecasting | ETTm2 | MAE0.255 | 63 | |
| Forecasting | ETTm1 | MAE0.343 | 49 | |
| Forecasting | Weather | MAE0.201 | 45 | |
| Time Series Forecasting | ETTh1 | MSE (Horizon 96)0.348 | 9 | |
| Time Series Forecasting | ETTh2 | MSE (F=96)0.266 | 9 | |
| Time Series Forecasting | ETTm1 | MSE (F=96)0.291 | 9 |