Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Cross-RAG: Zero-Shot Retrieval-Augmented Time Series Forecasting via Cross-Attention

About

Recent advances in time series foundation models (TSFMs) demonstrate strong expressive capacity through large-scale pretraining across diverse time series domains. Zero-shot time series forecasting with TSFMs, however, exhibits limited generalization to unseen datasets, which retrieval-augmented forecasting addresses by leveraging an external knowledge base. Existing approaches rely on a fixed number of retrieved samples that may introduce irrelevant information. To this end, we propose Cross-RAG, a zero-shot retrieval-augmented forecasting framework that selectively attends to query-relevant retrieved samples. Cross-RAG models input-level relevance between the query and retrieved samples via query-retrieval cross-attention, while jointly incorporating information from the query and retrieved samples. Extensive experiments demonstrate that Cross-RAG consistently improves zero-shot forecasting performance across various TSFMs and RAG methods, and additional analyses confirm its effectiveness across diverse retrieval scenarios. Code is available at https://github.com/seunghan96/cross-rag/.

Seunghan Lee, Jaehoon Lee, Jun Seo, Sungdong Yoo, Minjae Kim, Tae Yoon Lim, Dongwan Kang, Hwanil Choi, SoonYoung Lee, Wonbin Ahn• 2026

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingETTh1 (test)
MSE0.341
348
Time Series ForecastingETTm1 (test)
MSE0.29
278
Time Series ForecastingETTh2 (test)
MSE0.243
232
Time Series ForecastingWeather (test)
MSE0.144
200
Time Series ForecastingETTm2 (test)
MSE0.143
171
Time Series ForecastingElectricity (test)
MSE0.112
109
Univariate Time Series ForecastingExchange (test)
MSE0.064
46
Showing 7 of 7 rows

Other info

Follow for update