DiffPO: A causal diffusion model for learning distributions of potential outcomes
About
Predicting potential outcomes of interventions from observational data is crucial for decision-making in medicine, but the task is challenging due to the fundamental problem of causal inference. Existing methods are largely limited to point estimates of potential outcomes with no uncertain quantification; thus, the full information about the distributions of potential outcomes is typically ignored. In this paper, we propose a novel causal diffusion model called DiffPO, which is carefully designed for reliable inferences in medicine by learning the distribution of potential outcomes. In our DiffPO, we leverage a tailored conditional denoising diffusion model to learn complex distributions, where we address the selection bias through a novel orthogonal diffusion loss. Another strength of our DiffPO method is that it is highly flexible (e.g., it can also be used to estimate different causal quantities such as CATE). Across a wide range of experiments, we show that our method achieves state-of-the-art performance.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Individual Treatment Effect Estimation | IHDP (within-sample) | Sqrt PEHE0.79 | 59 | |
| Individual Treatment Effect Estimation | IHDP (out-of-sample) | sqrt(PEHE)0.84 | 55 | |
| Counterfactual Distribution Estimation | Colored MNIST a=0 | Mean Out-Sample W225.48 | 16 | |
| Conditional distribution estimation | IHDP100 a=1 (out-sample) | W2 Score0.033 | 16 | |
| Conditional distribution estimation | IHDP100 a=0 (out-sample) | W20.05 | 16 | |
| Counterfactual Distribution Estimation | Colored MNIST a=1 | Mean Out-Sample W222.53 | 16 | |
| Counterfactual Distribution Estimation | Colored MNIST a=2 | Mean Out-Sample W224.24 | 16 | |
| Counterfactual Distribution Estimation | Colored MNIST a=3 | Mean Out-Sample W223.13 | 16 | |
| Counterfactual Distribution Estimation | Colored MNIST a=4 | Mean Out-Sample W223.26 | 16 | |
| Causal effect estimation | ACIC in-sample 2018 | TOP1 % (PEHE sqrt)20.83 | 10 |