Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Temporal Label Smoothing for Early Event Prediction

About

Models that can predict the occurrence of events ahead of time with low false-alarm rates are critical to the acceptance of decision support systems in the medical community. This challenging task is typically treated as a simple binary classification, ignoring temporal dependencies between samples, whereas we propose to exploit this structure. We first introduce a common theoretical framework unifying dynamic survival analysis and early event prediction. Following an analysis of objectives from both fields, we propose Temporal Label Smoothing (TLS), a simpler, yet best-performing method that preserves prediction monotonicity over time. By focusing the objective on areas with a stronger predictive signal, TLS improves performance over all baselines on two large-scale benchmark tasks. Gains are particularly notable along clinically relevant measures, such as event recall at low false-alarm rates. TLS reduces the number of missed events by up to a factor of two over previously used approaches in early event prediction.

Hugo Y\`eche, Aliz\'ee Pace, Gunnar R\"atsch, Rita Kuznetsova• 2022

Related benchmarks

TaskDatasetResultRank
RetrievalChunQiuTR official (test)
R@156.38
25
Intraoperative Adverse Event PredictionMuAE Δ=15 1.0 (test)
Hypotension F116.81
11
Intraoperative Adverse Event PredictionMuAE Δ=10 1.0 (test)
Hypotension F119.09
11
Intraoperative Adverse Event PredictionMuAE Δ=5 1.0 (test)
F1 (Hypotension)36.71
11
Circulatory Failure PredictionHiRID (test)
AUPRC40.6
8
Decompensation PredictionMIMIC-III (test)
AUPRC35.5
8
Early prediction of ventilation onsetHiRID (val)
AUPRC34.7
3
Early prediction of respiratory failureHiRID (val)
AUPRC60.4
3
Showing 8 of 8 rows

Other info

Code

Follow for update