Nansde-net: A neural sde framework for generating time series with memory
About
Modeling time series with long- or short-memory characteristics is a fundamental challenge in many scientific and engineering domains. While fractional Brownian motion has been widely used as a noise source to capture such memory effects, its incompatibility with It\^o calculus limits its applicability in neural stochastic differential equation~(SDE) frameworks. In this paper, we propose a novel class of noise, termed Neural Network-kernel ARMA-type noise~(NA-noise), which is an It\^o-process-based alternative capable of capturing both long- and short-memory behaviors. The kernel function defining the noise structure is parameterized via neural networks and decomposed into a product form to preserve the Markov property. Based on this noise process, we develop NANSDE-Net, a generative model that extends Neural SDEs by incorporating NA-noise. We prove the theoretical existence and uniqueness of the solution under mild conditions and derive an efficient backpropagation scheme for training. Empirical results on both synthetic and real-world datasets demonstrate that NANSDE-Net matches or outperforms existing models, including fractional SDE-Net, in reproducing long- and short-memory features of the data, while maintaining computational tractability within the It\^o calculus framework.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Time-series generation | fBm H=0.2 | ACF1.276 | 4 | |
| Time-series generation | SPX | ACF2.804 | 4 | |
| Time-series generation | SX5E | ACF3.018 | 4 | |
| Time-series generation | NileMin | ACF2.938 | 4 | |
| Time-series generation | NhemiTemp | ACF4.804 | 4 | |
| Time-series generation | fBm H=0.3 | ACF1.995 | 4 | |
| Time-series generation | ethernetTraffic | ACF3.224 | 4 | |
| Time-series generation | TPX | ACF Deviation2.018 | 4 |