Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Neural Jump Stochastic Differential Equations

About

Many time series are effectively generated by a combination of deterministic continuous flows along with discrete jumps sparked by stochastic events. However, we usually do not have the equation of motion describing the flows, or how they are affected by jumps. To this end, we introduce Neural Jump Stochastic Differential Equations that provide a data-driven approach to learn continuous and discrete dynamic behavior, i.e., hybrid systems that both flow and jump. Our approach extends the framework of Neural Ordinary Differential Equations with a stochastic process term that models discrete events. We then model temporal point processes with a piecewise-continuous latent trajectory, where the discontinuities are caused by stochastic events whose conditional intensity depends on the latent state. We demonstrate the predictive capabilities of our model on a range of synthetic and real-world marked point process datasets, including classical point processes (such as Hawkes processes), awards on Stack Overflow, medical records, and earthquake monitoring.

Junteng Jia, Austin R. Benson• 2019

Related benchmarks

TaskDatasetResultRank
Temporal Point Process modelingReddit real-world (test)
Negative Log-Likelihood-1.0907
25
Temporal Point Process modelingMOOC real-world (test)
NLL0.871
25
Temporal Point Process modelingWiki real-world (test)
Negative Log-Likelihood-0.3115
18
Temporal Point Process modelingPoisson synthetic (test)
NLL0.9945
11
Temporal Point Process modelingHawkes1 synthetic (test)
Negative Log-Likelihood0.6461
11
Temporal Point Process modelingHawkes2 synthetic (test)
NLL0.2246
11
Temporal Point Process modelingRenewal synthetic (test)
NLL0.3124
11
Marked Temporal Point ProcessWiki (test)
NLL7.5537
7
Temporal Point ProcessWiki (test)
NLL-1.3635
7
Marked Temporal Point ProcessReddit (test)
NLL1.9057
7
Showing 10 of 11 rows

Other info

Follow for update