Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Retrieval Augmented Time Series Forecasting

About

Retrieval-augmented generation (RAG) is a central component of modern LLM systems, particularly in scenarios where up-to-date information is crucial for accurately responding to user queries or when queries exceed the scope of the training data. The advent of time-series foundation models (TSFM), such as Chronos, and the need for effective zero-shot forecasting performance across various time-series domains motivates the question: Do benefits of RAG similarly carry over to time series forecasting? In this paper, we advocate that the dynamic and event-driven nature of time-series data makes RAG a crucial component of TSFMs and introduce a principled RAG framework for time-series forecasting, called Retrieval Augmented Forecasting (RAF). Within RAF, we develop efficient strategies for retrieving related time-series examples and incorporating them into forecast. Through experiments and mechanistic studies, we demonstrate that RAF indeed improves the forecasting accuracy across diverse time series domains and the improvement is more significant for larger TSFM sizes.

Kutay Tire, Ege Onur Taga, Muhammed Emrullah Ildiz, Samet Oymak• 2024

Related benchmarks

TaskDatasetResultRank
Time Series ForecastingETTh1 (test)
MSE0.366
398
Traffic ForecastingMETR-LA
MAE0.682
329
Time Series ForecastingETTm1 (test)
MSE0.306
315
Time Series ForecastingECL
MSE0.207
294
Time Series ForecastingETTh2 (test)
MSE0.252
250
Time Series ForecastingWeather (test)
MSE0.178
248
Time Series ForecastingPeMS08
MSE1.376
229
Time Series ForecastingETTm2 (test)
MSE0.148
186
Time Series ForecastingPeMS04
MSE1.456
169
Time Series ForecastingElectricity (test)
MSE0.119
130
Showing 10 of 38 rows

Other info

Follow for update