MIMIC-III
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| ICD Coding | MIMIC-III 50 labels (test) | F1 Micro64.1 | 70 | |
| Counterfactual Outcome Prediction | MIMIC-III semi-synthetic (N=3000) (test) | RMSE0.24 | 35 | |
| Counterfactual Outcome Prediction | MIMIC-III semi-synthetic (N=1000) (test) | RMSE0.3 | 35 | |
| Relation Extraction | MIMIC-III (test) | Strict F186.7 | 26 | |
| Named Entity Recognition | MIMIC-III (test) | Strict F185.6 | 26 | |
| ICD coding | MIMIC-III full (test) | F1 Micro59.9 | 19 | |
| ICD-9 code prediction | MIMIC-III 8922 labels (full) | AUC Macro0.91 | 17 | |
| Disease Diagnosis | MIMIC-III 1.0 (test) | Micro Precision69.04 | 17 | |
| De-identification | MIMIC-III 100 discharge notes 1.4 (test) | Precision99 | 14 | |
| Medical Code Prediction | MIMIC-III full-label 1.4 (test) | F1 Micro0.586 | 14 | |
| Missing data estimation | MIMIC-III v1.4 (test) | Mean RMSE0.0141 | 13 | |
| Mortality Prediction | MIMIC-III target v1.4 | AUPRC16.95 | 10 | |
| ICD coding | MIMIC-III Full v1.4 (test) | Macro F10.123 | 10 | |
| In-hospital mortality prediction | MIMIC-III Hypertension | AUPRC47.27 | 10 | |
| Irregularly Sampled Time Series Forecasting | MIMIC-III 75%-3 task (test) | MSE0.396 | 9 | |
| Irregularly Sampled Time Series Forecasting | MIMIC-III 50%-50% task (test) | Inference Time (s)0.394 | 9 | |
| Decompensation Prediction | MIMIC-III (test) | AUPRC35.5 | 8 | |
| Text-to-UMLS linking | MIMIC-III unseen in WS n=174 (test) | Precision94.1 | 8 | |
| Text-to-UMLS | MIMIC-III Radiology n=53+/198 (External val) | Precision89.4 | 7 | |
| Counterfactual Average Path Outcome (CAPO) Estimation | Semi-synthetic MIMIC-III Expanded Time-varying Confounding (test) | Bias (CF 1)0.53 | 5 | |
| ICD-9 Code Prediction | MIMIC-III v1.4 (test) | Accuracy (140-239)91.58 | 5 | |
| Mortality Prediction | MIMIC-III v1.4 (test) | Accuracy78.1 | 5 | |
| Text-to-UMLS linking | MIMIC-III n=400 (val) | Precision90.1 | 4 | |
| Mechanical Ventilation Prediction | MIMIC-III 1.4 (test) | Onset AUROC87.1 | 4 | |
| Multi-task prediction | MIMIC-III ICD-9 20 tasks (test) | Average AUC71.23 | 4 |
Showing 25 of 32 rows