Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SHIFT: Robust Double Machine Learning for Average Dose-Response Functions under Heavy-Tailed Contamination

About

Double-machine-learning pipelines for the Average Dose-Response Function rely on kernel-weighted local-linear smoothers, which inherit unbounded functional influence: a single outlier within a kernel window biases the curve across the entire window. We introduce SHIFT (Self-calibrated Heavy-tail Inlier-Fit with Tempering), a robust DML estimator combining cross-fit nuisance orthogonalization with a kernel-local Welsch-loss second stage optimized by Graduated Non-Convexity, and -- the principal design choice -- a defensive OLS refit whose inlier cutoff is scaled by post-GNC residual MAD rather than the raw-outcome MAD. On a localized-contamination stress test at $p=0.25$ this design choice drops level-RMSE from 1.03 to 0.33 while leaving clean and uniformly-contaminated runs unchanged. Across 1,400 main-sweep fits, SHIFT has competitive worst-case shape recovery (RMSE $0.325$ at $p=0.25$, second to Huber-DML's $0.276$); among the three methods with worst-case RMSE below $0.35$, only SHIFT emits a non-uniform per-sample weight vector, recovering the ground-truth outlier mask at mean $F_1 \approx 0.96$ (range $0.945$--$0.968$) on Gaussian-jump DGPs. We pair the estimator with a six-technique Extreme Value Theory diagnostic suite (Hill, GPD-MLE/PWM, GEV, Mean Excess, parameter stability, causal tail coefficient) that lets a practitioner distinguish Frechet from Weibull regimes and choose between SHIFT and L1 alternatives on empirical grounds. Extensions to binary-treatment CATE (Huber pseudo-outcome X-Learner) and time-series ADRF (block-CV + rolling MAD) are included. A counter-intuitive ablation: linear nuisance models (Ridge, Lasso) outperform gradient-boosted nuisances for robust DML under uniform contamination, inverting the usual more-flexible-is-better heuristic.

Eichi Uehara• 2026

Related benchmarks

TaskDatasetResultRank
ADRF Estimationsinusoidal p=0.15
RMSE0.117
22
Derivative recoverysinusoidal p=0.25 (test)
MASE2.86
21
RegressionSinusoidal
RMSE0.094
15
Regressionsinusoidal_region
RMSE0.094
15
Regressionsinusoidal_heavytail
RMSE0.094
15
Average Dose-Response Function (ADRF) Estimationparabola p=0.25, n=800 synthetic (test)
Level-RMSE0.201
14
Average Dose-Response Function (ADRF) Estimationsinusoidal (p=0.25, n=800) synthetic (test)
Level-RMSE0.152
14
ADRF Estimationsinusoidal_region p=0.25
RMSE0.268
11
ADRF Estimationsinusoidal p=0.00
RMSE0.103
11
ADRF Estimationsinusoidal p=0.25
RMSE0.249
11
Showing 10 of 30 rows

Other info

Follow for update