Neural Jump Stochastic Differential Equations
About
Many time series are effectively generated by a combination of deterministic continuous flows along with discrete jumps sparked by stochastic events. However, we usually do not have the equation of motion describing the flows, or how they are affected by jumps. To this end, we introduce Neural Jump Stochastic Differential Equations that provide a data-driven approach to learn continuous and discrete dynamic behavior, i.e., hybrid systems that both flow and jump. Our approach extends the framework of Neural Ordinary Differential Equations with a stochastic process term that models discrete events. We then model temporal point processes with a piecewise-continuous latent trajectory, where the discontinuities are caused by stochastic events whose conditional intensity depends on the latent state. We demonstrate the predictive capabilities of our model on a range of synthetic and real-world marked point process datasets, including classical point processes (such as Hawkes processes), awards on Stack Overflow, medical records, and earthquake monitoring.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Temporal Point Process modeling | Reddit real-world (test) | Negative Log-Likelihood-1.0907 | 25 | |
| Temporal Point Process modeling | MOOC real-world (test) | NLL0.871 | 25 | |
| Temporal Point Process modeling | Wiki real-world (test) | Negative Log-Likelihood-0.3115 | 18 | |
| Temporal Point Process modeling | Poisson synthetic (test) | NLL0.9945 | 11 | |
| Temporal Point Process modeling | Hawkes1 synthetic (test) | Negative Log-Likelihood0.6461 | 11 | |
| Temporal Point Process modeling | Hawkes2 synthetic (test) | NLL0.2246 | 11 | |
| Temporal Point Process modeling | Renewal synthetic (test) | NLL0.3124 | 11 | |
| Marked Temporal Point Process | Wiki (test) | NLL7.5537 | 7 | |
| Temporal Point Process | Wiki (test) | NLL-1.3635 | 7 | |
| Marked Temporal Point Process | Reddit (test) | NLL1.9057 | 7 |