Twins
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Conditional Average Treatment Effect Estimation | Twins RCT | Multiplicative Calibration Error1.372 | 15 | |
| Uplift Modeling | Twins | Qini Coefficient0.092 | 15 | |
| Treatment Effect Estimation | TWINS | Mean Effect0 | 15 | |
| Counterfactual Error Estimation | Twins (in-sample) | AUC0.87 | 13 | |
| Counterfactual error estimation | Twins (out-sample) | AUC86.1 | 13 | |
| Causal Estimation | Twins Posterior | Mean BSE0.0001 | 10 | |
| Heterogeneous Treatment Effect Estimation | Twins censoring Real (test) | RMSE (L=30)2.63 | 9 | |
| Heterogeneous Treatment Effect Estimation | Twins no censoring Real (test) | RMSE (L=30)2.53 | 9 | |
| Counterfactual Distribution Estimation | TWINS HeavyTails outcome (synthetic) | Average W1 Error0.25 | 6 | |
| Continuous Treatment Effect Estimation | Twins | RMSE0.031 | 6 | |
| Average Treatment Effect Estimation | Twins (n=3200) | MAE (eATE)0.061 | 6 | |
| Average Treatment Effect Estimation | Twins (n=1600) | Mean Absolute ATE Error (eATE)0.061 | 6 | |
| Average Treatment Effect Estimation | Twins n=200 | MAE (eATE)0.065 | 6 | |
| Average Treatment Effect Estimation | Twins (n=50) | Mean Absolute ATE Error (eATE)0.062 | 6 | |
| Causal Estimation | Twins Prior | Mean BSE0.039 | 5 | |
| Individual Treatment Effect estimation | Twins (out-sample) | AUC0.861 | 5 | |
| Individual Treatment Effect Estimation | Twins (in-sample) | AUC0.87 | 5 | |
| Counterfactual Prediction | Twins RealCause (test) | Empirical Coverage99.8 | 3 | |
| Computational Efficiency Analysis | Twins | Runtime (s/it)68.748 | 2 | |
| Treatment Effect Estimation | Twins | Coverage Mean97.12 | 1 |
Showing 20 of 20 rows