Intensity-Free Learning of Temporal Point Processes
About
Temporal point processes are the dominant paradigm for modeling sequences of events happening at irregular intervals. The standard way of learning in such models is by estimating the conditional intensity function. However, parameterizing the intensity function usually incurs several trade-offs. We show how to overcome the limitations of intensity-based approaches by directly modeling the conditional distribution of inter-event times. We draw on the literature on normalizing flows to design models that are flexible and efficient. We additionally propose a simple mixture model that matches the flexibility of flow-based models, but also permits sampling and computing moments in closed form. The proposed models achieve state-of-the-art performance in standard prediction tasks and are suitable for novel applications, such as learning sequence embeddings and imputing missing data.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Event Prediction | StackOverflow | ACC44.9 | 58 | |
| Event Prediction | taxi | RMSEΔt0.335 | 40 | |
| Next event prediction | Taobao | Time RMSE0.531 | 33 | |
| Next event prediction | AMAZON | RMSE0.618 | 32 | |
| Event Prediction | Retweet | RMSE (Time)22.18 | 28 | |
| Next-event time and location prediction | Earthquake | Temporal RMSE2.55 | 27 | |
| Long-horizon prediction | AMAZON | RMSE (Δt)0.447 | 26 | |
| Temporal Point Process modeling | MOOC real-world (test) | NLL-0.4448 | 25 | |
| Temporal Point Process modeling | Reddit real-world (test) | Negative Log-Likelihood-0.9299 | 25 | |
| Event Forecasting | taxi | RMSE0.38 | 23 |