Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Resolving the bias-precision paradox with stochastic causal representation learning for personalized medicine

About

Estimating individualized treatment effects from longitudinal observational data is central to data-driven medicine, yet existing methods face a fundamental limitation: reducing confounding bias often suppresses clinically informative heterogeneity, degrading patient-specific predictions. Here, we identify this tension as a bias-precision paradox in causal representation learning and introduce sampling-based maximum mean discrepancy (sMMD), a stochastic alignment strategy that replaces global adversarial balancing with subset-level matching. We instantiate this approach in a framework for counterfactual outcome prediction with attribution-grounded interpretability. Across two large-scale ICU cohorts (n = 27,783), our framework improves accuracy under distribution shift, reducing error by up to 11.5% and substantially increasing recall in high-risk tasks. Mechanistic analyses show that sMMD selectively preserves clinically decisive variables. In human-AI evaluation, our method outperforms clinicians-in-training and large language models, and improves clinician accuracy by 14.7% while reducing decision time, enabling interpretable, real-time clinical decision support.

Peisong Zhang, Manqiang Peng, Yuxuan Wu, Pawit Phadungsaksawasdi, Wesley Yeung, Ye Zhang, Trang Nguyen, Qiang Zhang, Nan Liu, Meng Wang, Kee Yuan Ngiam, Yih-Chung Tham, Ching-Yu Cheng, Tianfan Fu, Qingyu Chen, Rosemary Ke, Chang Li, Wenzhuo Yang, Zhenghao Lu, Chunyou Lai, Yu Zhang, Sheng Zhong, Hao Deng, Dianbo Liu• 2026

Related benchmarks

TaskDatasetResultRank
Multi-step outcome predictionRW MIMIC-extract (Asian)
RMSE4.69
36
Multi-step outcome predictionRW MIMIC-extract (Latino)
RMSE4.57
36
Multi-step-ahead predictionMIMIC-III (African)
RMSE4.91
36
Multi-step-ahead predictionMIMIC-III (Asian)
RMSE (tau=1)4.67
6
Multi-step-ahead predictionMIMIC-III Latino
RMSE (tau=1)4.7
6
Multi-step-ahead predictionMIMIC-III Asian subgroup, OOD infectious and inflammatory diseases (out of distribution)
RMSE (τ=1)4.37
6
Multi-step-ahead predictionMIMIC-III African subgroup OOD infectious and inflammatory diseases (out of distribution)
RMSE (τ=1)4.92
6
Multi-step-ahead predictionMIMIC-III Cardiovascular (Asian)
RMSE (tau=1)4.15
6
Multi-step-ahead predictionMIMIC-III Cardiovascular African
RMSE ($ au=1$)4.71
6
Multi-step-ahead predictionMIMIC-III Cardiovascular Latino
RMSE (tau=1)3.66
6
Showing 10 of 11 rows

Other info

Follow for update