Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Entropic Projection Alignment: Estimating, Explaining, and Improving Model Performance Under Distribution Shift

About

We propose a unified framework for addressing three key challenges of distribution shift: (1) estimating a model's performance on an unlabeled target domain, (2) explaining the shift by identifying the features responsible, and (3) improving the target domain performance. Our method, Entropic Projection Alignment (EPA), aligns the source distribution to the target by matching carefully selected moments while simultaneously minimising the KL divergence from the source. This formulation yields a unique closed-form solution for importance weights, achieving robustness through implicit variance control. Drawing on domain adaptation theory, we establish that moment matching is sufficient for reliable estimation and adaptation, avoiding the need for full density ratio recovery. Extensive experiments, together with strong theoretical guarantees, demonstrate that EPA consistently outperforms state-of-the-art baselines while offering substantial computational efficiency.

Salim I. Amoukou, Emanuele Albini, Tom Bewley, Saumitra Mishra, Manuela Veloso• 2026

Related benchmarks

TaskDatasetResultRank
Model Improvement EstimationSparse Covariate Shift (test)
Average Improvement56.662
28
Shift EstimationSparse Covariate Shifts Linear Models
Estimation Inaccuracy (Bin 1)0.4
10
Shift EstimationSparse Joint Shift
Estimation Inaccuracy (0.159, 0.167)0.00e+0
9
RegressionCalifornia Housing
Estimation Inaccuracy1.2
8
ImprovementSparse Joint Shift
Avg Improvement (B1)17.65
7
ImprovementSparse Covariate Shift
Average Improvement (B1)13.86
7
Model ImprovementNatural shifts Bin (-0.082, -0.041)
Average Improvement25.824
6
Model ImprovementNatural shifts Bin (-0.041, -0.001)
Average Improvement18.047
6
Model ImprovementNatural shifts Bin (-0.001, 0.16)
Average Improvement27.189
6
Model ImprovementNatural shifts All-Bins
I-prop100
6
Showing 10 of 27 rows

Other info

Follow for update