Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Robust inference using density-powered Stein operators

About

We introduce a density-power weighted variant for the Stein operator, called the $\gamma$-Stein operator. This is a novel class of operators derived from the $\gamma$-divergence, designed to build robust inference methods for unnormalized probability models. The operator's construction (weighting by the model density raised to a positive power $\gamma$ inherently down-weights the influence of outliers, providing a principled mechanism for robustness. Applying this operator yields a robust generalization of score matching that retains the crucial property of being independent of the model's normalizing constant. We extend this framework to develop two key applications: the $\gamma$-kernelized Stein discrepancy for robust goodness-of-fit testing, and $\gamma$-Stein variational gradient descent for robust Bayesian posterior approximation. Empirical results on contaminated Gaussian and quartic potential models show our methods significantly outperform standard baselines in both robustness and statistical efficiency.

Shinto Eguchi• 2025

Related benchmarks

TaskDatasetResultRank
Goodness-of-fit testingSynthetic contaminated distribution 10% contamination
Test Power1
15
Parameter Estimationvon Mises-Fisher distribution ϵ = 0.05 contamination
Integrated RMSE0.56
6
Parameter Estimationvon Mises-Fisher distribution ϵ = 0.10 contamination
Integrated RMSE0.55
6
Parameter Estimationvon Mises-Fisher distribution ϵ = 0.20 contamination
Integrated RMSE0.73
6
Parameter Estimationvon Mises-Fisher distribution ϵ = 0.00 contamination
Integrated RMSE0.45
6
Posterior PredictionPoisson log-linear regression clean scenario
Posterior Predictive RMSE18.567
5
Posterior PredictionPoisson log-linear regression Y-contam scenario
Posterior Predictive RMSE18.341
5
Posterior PredictionPoisson log-linear regression X-contam scenario
Posterior Predictive RMSE21.306
5
Posterior PredictionPoisson log-linear regression X+Y-contam scenario
Posterior Predictive RMSE20.179
5
Parameter EstimationQuartic potential model No Outliers
Mean θ_1 Estimate0.0071
4
Showing 10 of 12 rows

Other info

Follow for update