Decoupled Marked Temporal Point Process using Neural Ordinary Differential Equations
About
A Marked Temporal Point Process (MTPP) is a stochastic process whose realization is a set of event-time data. MTPP is often used to understand complex dynamics of asynchronous temporal events such as money transaction, social media, healthcare, etc. Recent studies have utilized deep neural networks to capture complex temporal dependencies of events and generate embedding that aptly represent the observed events. While most previous studies focus on the inter-event dependencies and their representations, how individual events influence the overall dynamics over time has been under-explored. In this regime, we propose a Decoupled MTPP framework that disentangles characterization of a stochastic process into a set of evolving influences from different events. Our approach employs Neural Ordinary Differential Equations (Neural ODEs) to learn flexible continuous dynamics of these influences while simultaneously addressing multiple inference problems, such as density estimation and survival rate computation. We emphasize the significance of disentangling the influences by comparing our framework with state-of-the-art methods on real-life datasets, and provide analysis on the model behavior for potential applications.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Event Prediction | StackOverflow | ACC49.6 | 58 | |
| Event Prediction | taxi | RMSEΔt0.283 | 40 | |
| Next event prediction | Taobao | Time RMSE0.223 | 33 | |
| Next event prediction | AMAZON | RMSE0.346 | 32 | |
| Event Prediction | Retweet | RMSE (Time)17.89 | 28 | |
| Next-event time and location prediction | Earthquake | Temporal RMSE1.372 | 27 | |
| Long-horizon prediction | AMAZON | RMSE (Δt)0.332 | 26 | |
| Multi-horizon forecasting | taxi | Inter-event Time RMSE0.285 | 15 | |
| Multi-horizon forecasting | StackOverflow | Inter-event Time RMSE0.851 | 15 | |
| Multi-horizon forecasting | Retweet | Inter-event Time RMSE16.2 | 15 |