Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Synthetic Counterfactual Labels for Efficient Conformal Counterfactual Inference

About

This work addresses the problem of constructing reliable prediction intervals for individual counterfactual outcomes. Existing conformal counterfactual inference (CCI) methods provide marginal coverage guarantees but often produce overly conservative intervals, particularly under treatment imbalance when counterfactual samples are scarce. We introduce synthetic data-powered CCI (SP-CCI), a new framework that augments the calibration set with synthetic counterfactual labels generated by a pre-trained counterfactual model. To ensure validity, SP-CCI incorporates synthetic samples into a conformal calibration procedure based on risk-controlling prediction sets (RCPS) with a debiasing step informed by prediction-powered inference (PPI). We prove that SP-CCI achieves tighter prediction intervals while preserving marginal coverage, with theoretical guarantees under both exact and approximate importance weighting. Empirical results on different datasets confirm that SP-CCI consistently reduces interval width compared to standard CCI across all settings.

Amirmohammad Farzaneh, Matteo Zecchin, Osvaldo Simeone• 2025

Related benchmarks

TaskDatasetResultRank
Counterfactual InferenceIHDP (test)
APIW3.521
7
Counterfactual Prediction Interval EstimationIHDP
APIW15.93
6
Counterfactual Prediction Interval EstimationSynthetic
APIW1.98
6
Counterfactual PredictionTwins RealCause (test)
Empirical Coverage93.1
3
Showing 4 of 4 rows

Other info

Follow for update