Entropic Projection Alignment: Estimating, Explaining, and Improving Model Performance Under Distribution Shift
About
We propose a unified framework for addressing three key challenges of distribution shift: (1) estimating a model's performance on an unlabeled target domain, (2) explaining the shift by identifying the features responsible, and (3) improving the target domain performance. Our method, Entropic Projection Alignment (EPA), aligns the source distribution to the target by matching carefully selected moments while simultaneously minimising the KL divergence from the source. This formulation yields a unique closed-form solution for importance weights, achieving robustness through implicit variance control. Drawing on domain adaptation theory, we establish that moment matching is sufficient for reliable estimation and adaptation, avoiding the need for full density ratio recovery. Extensive experiments, together with strong theoretical guarantees, demonstrate that EPA consistently outperforms state-of-the-art baselines while offering substantial computational efficiency.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Model Improvement Estimation | Sparse Covariate Shift (test) | Average Improvement56.662 | 28 | |
| Shift Estimation | Sparse Covariate Shifts Linear Models | Estimation Inaccuracy (Bin 1)0.4 | 10 | |
| Shift Estimation | Sparse Joint Shift | Estimation Inaccuracy (0.159, 0.167)0.00e+0 | 9 | |
| Regression | California Housing | Estimation Inaccuracy1.2 | 8 | |
| Improvement | Sparse Joint Shift | Avg Improvement (B1)17.65 | 7 | |
| Improvement | Sparse Covariate Shift | Average Improvement (B1)13.86 | 7 | |
| Model Improvement | Natural shifts Bin (-0.082, -0.041) | Average Improvement25.824 | 6 | |
| Model Improvement | Natural shifts Bin (-0.041, -0.001) | Average Improvement18.047 | 6 | |
| Model Improvement | Natural shifts Bin (-0.001, 0.16) | Average Improvement27.189 | 6 | |
| Model Improvement | Natural shifts All-Bins | I-prop100 | 6 |