Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Are KANs Effective for Multivariate Time Series Forecasting?

About

Multivariate time series forecasting is a crucial task that predicts the future states based on historical inputs. Related techniques have been developing in parallel with the machine learning community, from early statistical learning methods to current deep learning methods. Despite their significant advancements, existing methods continue to struggle with the challenge of inadequate interpretability. The rise of the Kolmogorov-Arnold Network (KAN) provides a new perspective to solve this challenge, but current work has not yet concluded whether KAN is effective in time series forecasting tasks. In this paper, we aim to evaluate the effectiveness of KANs in time-series forecasting from the perspectives of performance, integrability, efficiency, and interpretability. To this end, we propose the Multi-layer Mixture-of-KAN network (MMK), which achieves excellent performance while retaining KAN's ability to be transformed into a combination of symbolic functions. The core module of MMK is the mixture-of-KAN layer, which uses a mixture-of-experts structure to assign variables to best-matched KAN experts. Then, we explore some useful experimental strategies to deal with the issues in the training stage. Finally, we compare MMK and various baselines on seven datasets. Extensive experimental and visualization results demonstrate that KANs are effective in multivariate time series forecasting. Code is available at: https://github.com/2448845600/EasyTSF.

Xiao Han, Xinfeng Zhang, Yiling Wu, Zhenduo Zhang, Zhe Wu• 2024

Related benchmarks

TaskDatasetResultRank
Multivariate long-term forecastingETTh1
MSE0.374
472
Multivariate long-term series forecastingETTh2
MSE0.301
445
Multivariate long-term series forecastingWeather
MSE0.171
425
Multivariate long-term series forecastingETTm1
MSE0.32
383
Multivariate long-term series forecastingETTm2
MSE0.176
301
Multivariate long-term forecastingTraffic
MSE0.529
190
Multivariate long-term forecastingECL
MSE0.178
109
Showing 7 of 7 rows

Other info

Follow for update