Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

IHDP

Benchmarks

Task NameDataset NameSOTA ResultTrend
Individual Treatment Effect EstimationIHDP (within-sample)
Sqrt PEHE0.604
49
Individual Treatment Effect EstimationIHDP (out-of-sample)
sqrt(PEHE)0.613
32
Treatment Effect EstimationIHDP
PEHE Mean3.3
24
Causal InferenceIHDP
MSE0.0767
20
CATE estimationIHDP Setup D (out-of-sample)
Normalized RMSE0.2
17
CATE estimationIHDP Setup D (in-sample)
Normalized RMSE0.2
17
CATE estimationIHDP Setup C (out-of-sample)
Normalized RMSE0.29
17
CATE estimationIHDP Setup C (in-sample)
NRMSE0.268
17
ATE estimationIHDP
Joint Bias (JB)0.076
14
CATE EstimationIHDP (Out-sample)
PEHE1.282
13
CATE EstimationIHDP (In-sample)
PEHE0.502
13
Causal Effect EstimationIHDP U -> X (test)
Mean Absolute ATE Prop Error53.4
11
Causal Effect EstimationIHDP 40 confounded datasets with no true instrument candidate
Mean Abs ATE Prop Error0.566
9
Causal Effect EstimationIHDP 1000 realizations from NPCI package (heldout)
MAE0.2
9
Causal Effect EstimationIHDP 1000 realizations from NPCI package (train val)
MAE0.14
9
CATE estimationIHDP-100 Setup D (out-of-sample)
RMSE1.392
8
CATE estimationIHDP-100 Setup D (in-sample)
RMSE1.394
8
Average Treatment Effect EstimationIHDP
Running Time (s)0.03
7
ATE EstimationIHDP
Memory Consumption (MB)468.19
7
Variation in Treatment Effect (VTE) estimationIHDP
MAE0.06
5
Causal Effect EstimationIHDP 1000 realizations from NPCI package (all data)
MAE0.11
4
Distributional treatment effect testingIHDP Scenario VI Hill (test)
TPR4
4
Distributional treatment effect testingIHDP Scenario V Hill (test)
True Positive Rate1
4
Distributional treatment effect testingIHDP Scenario IV Hill (test)
True Positive Rate53
4
Distributional treatment effect testingIHDP Scenario III Hill (test)
TPR0.34
4
Showing 25 of 27 rows