Transparent Networks for Multivariate Time Series
About
Transparent models, which provide inherently interpretable predictions, are receiving significant attention in high-stakes domains. However, despite much real-world data being collected as time series, there is a lack of studies on transparent time series models. To address this gap, we propose a novel transparent neural network model for time series called Generalized Additive Time Series Model (GATSM). GATSM consists of two parts: 1) independent feature networks to learn feature representations, and 2) a transparent temporal module to learn temporal patterns across different time steps using the feature representations. This structure allows GATSM to effectively capture temporal patterns and handle varying-length time series while preserving transparency. Empirical experiments show that GATSM significantly outperforms existing generalized additive models and achieves comparable performance to black-box time series models, such as recurrent neural networks and Transformer. In addition, we demonstrate that GATSM finds interesting patterns in time series.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Regression | Univariate synthetic (test) | RMSE0.0081 | 16 | |
| Time Series Regression | BridgeDegradation (test) | RMSE0.0326 | 16 | |
| Regression | Bivariate synthetic (test) | RMSE0.0901 | 16 | |
| Regression | Trivariate-1 synthetic (test) | RMSE0.2131 | 16 | |
| Regression | Trivariate-2 synthetic (test) | RMSE0.2196 | 16 | |
| Time Series Regression | BenzeneConcentration (test) | RMSE1.5894 | 16 | |
| Time Series Regression | WindTurbinePower (test) | RMSE355.5 | 16 | |
| Time Series Regression | HouseholdPowerC1 (test) | RMSE160.2 | 15 |