Resolving the bias-precision paradox with stochastic causal representation learning for personalized medicine
About
Estimating individualized treatment effects from longitudinal observational data is central to data-driven medicine, yet existing methods face a fundamental limitation: reducing confounding bias often suppresses clinically informative heterogeneity, degrading patient-specific predictions. Here, we identify this tension as a bias-precision paradox in causal representation learning and introduce sampling-based maximum mean discrepancy (sMMD), a stochastic alignment strategy that replaces global adversarial balancing with subset-level matching. We instantiate this approach in a framework for counterfactual outcome prediction with attribution-grounded interpretability. Across two large-scale ICU cohorts (n = 27,783), our framework improves accuracy under distribution shift, reducing error by up to 11.5% and substantially increasing recall in high-risk tasks. Mechanistic analyses show that sMMD selectively preserves clinically decisive variables. In human-AI evaluation, our method outperforms clinicians-in-training and large language models, and improves clinician accuracy by 14.7% while reducing decision time, enabling interpretable, real-time clinical decision support.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multi-step outcome prediction | RW MIMIC-extract (Asian) | RMSE4.69 | 36 | |
| Multi-step outcome prediction | RW MIMIC-extract (Latino) | RMSE4.57 | 36 | |
| Multi-step-ahead prediction | MIMIC-III (African) | RMSE4.91 | 36 | |
| Multi-step-ahead prediction | MIMIC-III (Asian) | RMSE (tau=1)4.67 | 6 | |
| Multi-step-ahead prediction | MIMIC-III Latino | RMSE (tau=1)4.7 | 6 | |
| Multi-step-ahead prediction | MIMIC-III Asian subgroup, OOD infectious and inflammatory diseases (out of distribution) | RMSE (τ=1)4.37 | 6 | |
| Multi-step-ahead prediction | MIMIC-III African subgroup OOD infectious and inflammatory diseases (out of distribution) | RMSE (τ=1)4.92 | 6 | |
| Multi-step-ahead prediction | MIMIC-III Cardiovascular (Asian) | RMSE (tau=1)4.15 | 6 | |
| Multi-step-ahead prediction | MIMIC-III Cardiovascular African | RMSE ($ au=1$)4.71 | 6 | |
| Multi-step-ahead prediction | MIMIC-III Cardiovascular Latino | RMSE (tau=1)3.66 | 6 |