Doctor AI: Predicting Clinical Events via Recurrent Neural Networks
About
Leveraging large historical data in electronic health record (EHR), we developed Doctor AI, a generic predictive model that covers observed medical conditions and medication uses. Doctor AI is a temporal model using recurrent neural networks (RNN) and was developed and applied to longitudinal time stamped EHR data from 260K patients over 8 years. Encounter records (e.g. diagnosis codes, medication codes or procedure codes) were input to RNN to predict (all) the diagnosis and medication categories for a subsequent visit. Doctor AI assesses the history of patients to make multilabel predictions (one label for each diagnosis or medication category). Based on separate blind test set evaluation, Doctor AI can perform differential diagnosis with up to 79% recall@30, significantly higher than several baselines. Moreover, we demonstrate great generalizability of Doctor AI by adapting the resulting models from one institution to another without losing substantial accuracy.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Missing data estimation | Biobank | Mean RMSE0.0812 | 13 | |
| Patient state prediction | Biobank (test) | AUROC88.02 | 13 | |
| Missing data estimation | Deterioration | RMSE0.0258 | 13 | |
| Patient state prediction | Deterioration (test) | AUROC0.7558 | 13 | |
| Missing data estimation | MIMIC-III v1.4 (test) | Mean RMSE0.0337 | 13 | |
| Patient state prediction | MIMIC-III (test) | AUROC83.81 | 13 | |
| Patient state prediction | UNOS-Lung (test) | AUROC0.6557 | 12 | |
| Patient state prediction | UNOS-Heart (test) | AUROC65.05 | 12 | |
| Missing data estimation | UNOS Heart | Mean RMSE0.1352 | 12 | |
| Missing data estimation | UNOS-Lung | Mean RMSE0.1343 | 12 |