Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
About
Many scientific and engineering challenges -- ranging from personalized medicine to customized marketing recommendations -- require an understanding of treatment effect heterogeneity. In this paper, we develop a non-parametric causal forest for estimating heterogeneous treatment effects that extends Breiman's widely used random forest algorithm. In the potential outcomes framework with unconfoundedness, we show that causal forests are pointwise consistent for the true treatment effect, and have an asymptotically Gaussian and centered sampling distribution. We also discuss a practical method for constructing asymptotic confidence intervals for the true treatment effect that are centered at the causal forest estimates. Our theoretical results rely on a generic Gaussian theory for a large family of random forest algorithms. To our knowledge, this is the first set of results that allows any type of random forest, including classification and regression forests, to be used for provably valid statistical inference. In experiments, we find causal forests to be substantially more powerful than classical methods based on nearest-neighbor matching, especially in the presence of irrelevant covariates.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Individual Treatment Effect Estimation | IHDP (within-sample) | Sqrt PEHE3.8 | 49 | |
| Individual Treatment Effect Estimation | IHDP (out-of-sample) | sqrt(PEHE)3.8 | 32 | |
| Individual Treatment Effect Estimation | Jobs (out-of-sample) | R_pol0.2 | 32 | |
| Binary Treatment Effect Estimation | ACIC Datasets-10k 2018 | Epsilon ATE0.0057 | 24 | |
| Binary Treatment Effect Estimation | ACIC Datasets-50k 2018 | Epsilon ATE0.01 | 24 | |
| Binary Treatment Effect Estimation | ACIC Datasets-1k 2018 | Epsilon ATE0.017 | 24 | |
| Individual Treatment Effect Estimation | Jobs (within-sample) | R_pol0.19 | 18 | |
| CATE estimation | ACIC 2016 (Out-sample) | PEHE3.196 | 13 | |
| CATE estimation | ACIC 2016 (In-sample) | PEHE3.449 | 13 | |
| CATE estimation | IHDP (Out-sample) | PEHE3.136 | 13 |