Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Koopman Neural Forecaster for Time Series with Temporal Distribution Shifts

About

Temporal distributional shifts, with underlying dynamics changing over time, frequently occur in real-world time series and pose a fundamental challenge for deep neural networks (DNNs). In this paper, we propose a novel deep sequence model based on the Koopman theory for time series forecasting: Koopman Neural Forecaster (KNF) which leverages DNNs to learn the linear Koopman space and the coefficients of chosen measurement functions. KNF imposes appropriate inductive biases for improved robustness against distributional shifts, employing both a global operator to learn shared characteristics and a local operator to capture changing dynamics, as well as a specially-designed feedback loop to continuously update the learned operators over time for rapidly varying behaviors. We demonstrate that \ours{} achieves superior performance compared to the alternatives, on multiple time series datasets that are shown to suffer from distribution shifts.

Rui Wang, Yihe Dong, Sercan \"O. Arik, Rose Yu• 2022

Related benchmarks

TaskDatasetResultRank
Multivariate ForecastingETTh1
MSE0.801
645
Multivariate Time-series ForecastingETTm1
MSE0.896
433
Multivariate Time-series ForecastingETTm2
MSE0.621
334
Multivariate long-term series forecastingTraffic (test)
MSE0.621
219
Multivariate long-term series forecastingExchange (test)
MSE0.128
145
Multivariate Time-series ForecastingWeather (test)
MSE0.201
124
Multivariate long-term time series forecastingILI (test)
MSE2.974
96
Multivariate Time-series ForecastingECL (test)
MSE0.175
77
Multivariate Time-series ForecastingETTh2 hourly (test)
MSE0.385
62
Univariate Time Series ForecastingM4
SMAPE12.126
10
Showing 10 of 10 rows

Other info

Follow for update