Doctor AI: Predicting Clinical Events via Recurrent Neural Networks
About
Leveraging large historical data in electronic health record (EHR), we developed Doctor AI, a generic predictive model that covers observed medical conditions and medication uses. Doctor AI is a temporal model using recurrent neural networks (RNN) and was developed and applied to longitudinal time stamped EHR data from 260K patients over 8 years. Encounter records (e.g. diagnosis codes, medication codes or procedure codes) were input to RNN to predict (all) the diagnosis and medication categories for a subsequent visit. Doctor AI assesses the history of patients to make multilabel predictions (one label for each diagnosis or medication category). Based on separate blind test set evaluation, Doctor AI can perform differential diagnosis with up to 79% recall@30, significantly higher than several baselines. Moreover, we demonstrate great generalizability of Doctor AI by adapting the resulting models from one institution to another without losing substantial accuracy.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Audio Classification | Speech Commands (test) | Accuracy45.3 | 65 | |
| Time-series classification | PhysioNet Sepsis (test) | AUROC87.8 | 54 | |
| Multivariate Time Series Classification | UEA 30% missing rate (test) | Accuracy63.6 | 39 | |
| Classification | BasicMotions 50% Missing | Accuracy96.7 | 38 | |
| Time-series classification | 18 UEA datasets Regular | Accuracy62.9 | 38 | |
| Time-series classification | UEA 18 datasets 70% Missing | Accuracy64.9 | 34 | |
| Forecasting | MuJoCo Regular (test) | MSE0.223 | 27 | |
| Forecasting | MuJoCo 30% Dropped (test) | MSE0.198 | 27 | |
| Forecasting | MuJoCo 50% Dropped (test) | MSE0.193 | 27 | |
| Forecasting | MuJoCo 70% Dropped (test) | MSE0.196 | 27 |