Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Koopman Neural Forecaster for Time Series with Temporal Distribution Shifts

About

Temporal distributional shifts, with underlying dynamics changing over time, frequently occur in real-world time series and pose a fundamental challenge for deep neural networks (DNNs). In this paper, we propose a novel deep sequence model based on the Koopman theory for time series forecasting: Koopman Neural Forecaster (KNF) which leverages DNNs to learn the linear Koopman space and the coefficients of chosen measurement functions. KNF imposes appropriate inductive biases for improved robustness against distributional shifts, employing both a global operator to learn shared characteristics and a local operator to capture changing dynamics, as well as a specially-designed feedback loop to continuously update the learned operators over time for rapidly varying behaviors. We demonstrate that \ours{} achieves superior performance compared to the alternatives, on multiple time series datasets that are shown to suffer from distribution shifts.

Rui Wang, Yihe Dong, Sercan \"O. Arik, Rose Yu• 2022

Related benchmarks

TaskDatasetResultRank
Multivariate ForecastingETTh1
MSE0.801
830
Multivariate Time-series ForecastingETTm1
MSE0.896
686
Multivariate Time-series ForecastingETTm2
MSE0.621
539
Multivariate long-term series forecastingTraffic (test)
MSE0.621
226
Multivariate long-term series forecastingExchange (test)
MSE0.128
159
Multivariate Time-series ForecastingWeather (test)
MSE0.201
145
Multivariate long-term time series forecastingILI (test)
MSE2.974
108
Multivariate Time-series ForecastingECL (test)
MSE0.175
81
Multivariate Time-series ForecastingETTh2 hourly (test)
MSE0.385
62
Univariate Time Series ForecastingM4
SMAPE12.126
18
Showing 10 of 10 rows

Other info

Follow for update