Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Adversary-Free Counterfactual Prediction via Information-Regularized Representations

About

We study counterfactual prediction under assignment bias and propose a mathematically grounded, information-theoretic approach that removes treatment-covariate dependence without adversarial training. Starting from a bound that links the counterfactual-factual risk gap to mutual information, we learn a stochastic representation Z that is predictive of outcomes while minimizing I(Z; T). We derive a tractable variational objective that upper-bounds the information term and couples it with a supervised decoder, yielding a stable, provably motivated training criterion. The framework extends naturally to dynamic settings by applying the information penalty to sequential representations at each decision time. We evaluate the method on controlled numerical simulations and a real-world clinical dataset, comparing against recent state-of-the-art balancing, reweighting, and adversarial baselines. Across metrics of likelihood, counterfactual error, and policy evaluation, our approach performs favorably while avoiding the training instabilities and tuning burden of adversarial schemes.

Shiqin Tang, Rong Feng, Shuxin Zhuang, Youzhi Zhang, Hongzong Li• 2025

Related benchmarks

TaskDatasetResultRank
Counterfactual PredictionSynthetic dataset
ATE Error1.00e-4
42
Counterfactual PredictionSynthetic dataset
RMSEy0.5375
42
Counterfactual PredictionSynthetic Dataset (test)
PEHE0.1635
42
Counterfactual PredictionSynthetic Dynamic Simulation Data
ATE Error0.0029
25
Counterfactual PredictionSynthetic Dataset dt=200
PEHE1.18
6
Counterfactual PredictionSynthetic Dataset dt=500
PEHE3.44
6
Counterfactual PredictionSynthetic Dataset dt=1000
PEHE8.34
6
Factual PredictionNHANES 2017-2018
RMSE0.0285
6
Off-policy targetingNHANES 2017-2018
AUUC27.61
6
Counterfactual PredictionSynthetic Dynamic Simulation dt=2
RMSEy0.2288
5
Showing 10 of 19 rows

Other info

Follow for update