Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Cross-RAG: Zero-Shot Retrieval-Augmented Time Series Forecasting via Cross-Attention

About

Recent advances in time series foundation models (TSFMs) demonstrate strong expressive capacity through large-scale pretraining across diverse time series domains. Zero-shot time series forecasting with TSFMs, however, exhibits limited generalization to unseen datasets, which retrieval-augmented forecasting addresses by leveraging an external knowledge base. Existing approaches rely on a fixed number of retrieved samples that may introduce irrelevant information. To this end, we propose Cross-RAG, a zero-shot retrieval-augmented forecasting framework that selectively attends to query-relevant retrieved samples. Cross-RAG models input-level relevance between the query and retrieved samples via query-retrieval cross-attention, while jointly incorporating information from the query and retrieved samples. Extensive experiments demonstrate that Cross-RAG consistently improves zero-shot forecasting performance across various TSFMs and RAG methods, and additional analyses confirm its effectiveness across diverse retrieval scenarios. Code is available at https://github.com/seunghan96/cross-rag/.

Seunghan Lee, Jaehoon Lee, Jun Seo, Sungdong Yoo, Minjae Kim, Tae Yoon Lim, Dongwan Kang, Hwanil Choi, SoonYoung Lee, Wonbin Ahn• 2026

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingETTh1 (test)
MSE0.341
398
Time Series ForecastingETTm1 (test)
MSE0.29
315
Long-term forecastingETTh2
MSE0.243
310
Time Series ForecastingETTh2 (test)
MSE0.243
250
Time Series ForecastingWeather (test)
MSE0.144
248
Time Series ForecastingETTm2 (test)
MSE0.143
186
Time Series ForecastingElectricity (test)
MSE0.112
130
Univariate Time Series ForecastingExchange (test)
MSE0.064
46
ForecastingWeather
MAE0.181
41
ForecastingETTh1
MSE0.347
22
Showing 10 of 14 rows

Other info

Follow for update