Task-oriented Time Series Imputation Evaluation via Generalized Representers
About
Time series analysis is widely used in many fields such as power energy, economics, and transportation, including different tasks such as forecasting, anomaly detection, classification, etc. Missing values are widely observed in these tasks, and often leading to unpredictable negative effects on existing methods, hindering their further application. In response to this situation, existing time series imputation methods mainly focus on restoring sequences based on their data characteristics, while ignoring the performance of the restored sequences in downstream tasks. Considering different requirements of downstream tasks (e.g., forecasting), this paper proposes an efficient downstream task-oriented time series imputation evaluation approach. By combining time series imputation with neural network models used for downstream tasks, the gain of different imputation strategies on downstream tasks is estimated without retraining, and the most favorable imputation value for downstream tasks is given by combining different imputation strategies according to the estimated gain.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Time Series Forecasting | ETTh1 | MSE0.0522 | 601 | |
| Long-term forecasting | ETTh2 | MSE0.1784 | 163 | |
| Time Series Forecasting | Electricity | MSE0.046 | 161 | |
| Forecasting | Traffic | MSE0.4147 | 60 | |
| Forecasting | GEF | MSE0.1653 | 22 | |
| Forecasting | AIR | MSE0.1491 | 22 | |
| Multivariate Time-series Forecasting | GEF | MSE0.1747 | 13 | |
| Multivariate Forecasting | ELECTRICITY (first three users) | MSE0.147 | 11 | |
| Time Series Forecasting | UCI Electricity 15-minute resolution (test) | MSE0.236 | 6 |