Temporal Label Smoothing for Early Event Prediction
About
Models that can predict the occurrence of events ahead of time with low false-alarm rates are critical to the acceptance of decision support systems in the medical community. This challenging task is typically treated as a simple binary classification, ignoring temporal dependencies between samples, whereas we propose to exploit this structure. We first introduce a common theoretical framework unifying dynamic survival analysis and early event prediction. Following an analysis of objectives from both fields, we propose Temporal Label Smoothing (TLS), a simpler, yet best-performing method that preserves prediction monotonicity over time. By focusing the objective on areas with a stronger predictive signal, TLS improves performance over all baselines on two large-scale benchmark tasks. Gains are particularly notable along clinically relevant measures, such as event recall at low false-alarm rates. TLS reduces the number of missed events by up to a factor of two over previously used approaches in early event prediction.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Circulatory Failure Prediction | HiRID (test) | AUPRC40.6 | 8 | |
| Decompensation Prediction | MIMIC-III (test) | AUPRC35.5 | 8 | |
| Early prediction of ventilation onset | HiRID (val) | AUPRC34.7 | 3 | |
| Early prediction of respiratory failure | HiRID (val) | AUPRC60.4 | 3 |