SHIFT: Robust Double Machine Learning for Average Dose-Response Functions under Heavy-Tailed Contamination
About
Double-machine-learning pipelines for the Average Dose-Response Function rely on kernel-weighted local-linear smoothers, which inherit unbounded functional influence: a single outlier within a kernel window biases the curve across the entire window. We introduce SHIFT (Self-calibrated Heavy-tail Inlier-Fit with Tempering), a robust DML estimator combining cross-fit nuisance orthogonalization with a kernel-local Welsch-loss second stage optimized by Graduated Non-Convexity, and -- the principal design choice -- a defensive OLS refit whose inlier cutoff is scaled by post-GNC residual MAD rather than the raw-outcome MAD. On a localized-contamination stress test at $p=0.25$ this design choice drops level-RMSE from 1.03 to 0.33 while leaving clean and uniformly-contaminated runs unchanged. Across 1,400 main-sweep fits, SHIFT has competitive worst-case shape recovery (RMSE $0.325$ at $p=0.25$, second to Huber-DML's $0.276$); among the three methods with worst-case RMSE below $0.35$, only SHIFT emits a non-uniform per-sample weight vector, recovering the ground-truth outlier mask at mean $F_1 \approx 0.96$ (range $0.945$--$0.968$) on Gaussian-jump DGPs. We pair the estimator with a six-technique Extreme Value Theory diagnostic suite (Hill, GPD-MLE/PWM, GEV, Mean Excess, parameter stability, causal tail coefficient) that lets a practitioner distinguish Frechet from Weibull regimes and choose between SHIFT and L1 alternatives on empirical grounds. Extensions to binary-treatment CATE (Huber pseudo-outcome X-Learner) and time-series ADRF (block-CV + rolling MAD) are included. A counter-intuitive ablation: linear nuisance models (Ridge, Lasso) outperform gradient-boosted nuisances for robust DML under uniform contamination, inverting the usual more-flexible-is-better heuristic.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| ADRF Estimation | sinusoidal p=0.15 | RMSE0.117 | 22 | |
| Derivative recovery | sinusoidal p=0.25 (test) | MASE2.86 | 21 | |
| Regression | Sinusoidal | RMSE0.094 | 15 | |
| Regression | sinusoidal_region | RMSE0.094 | 15 | |
| Regression | sinusoidal_heavytail | RMSE0.094 | 15 | |
| Average Dose-Response Function (ADRF) Estimation | parabola p=0.25, n=800 synthetic (test) | Level-RMSE0.201 | 14 | |
| Average Dose-Response Function (ADRF) Estimation | sinusoidal (p=0.25, n=800) synthetic (test) | Level-RMSE0.152 | 14 | |
| ADRF Estimation | sinusoidal_region p=0.25 | RMSE0.268 | 11 | |
| ADRF Estimation | sinusoidal p=0.00 | RMSE0.103 | 11 | |
| ADRF Estimation | sinusoidal p=0.25 | RMSE0.249 | 11 |