Hellinger loss function for Generative Adversarial Networks
About
We propose Hellinger-type loss functions for training Generative Adversarial Networks (GANs), motivated by the boundedness, symmetry, and robustness properties of the Hellinger distance. We define an adversarial objective based on this divergence and study its statistical properties within a general parametric framework. We establish the existence, uniqueness, consistency, and joint asymptotic normality of the estimators obtained from the adversarial training procedure. In particular, we analyze the joint estimation of both generator and discriminator parameters, offering a comprehensive asymptotic characterization of the resulting estimators. We introduce two implementations of the Hellinger-type loss and we evaluate their empirical behavior in comparison with the classic (Maximum Likelihood-type) GAN loss. Through a controlled simulation study, we demonstrate that both proposed losses yield improved estimation accuracy and robustness under increasing levels of data contamination.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Joint parameter estimation | Contaminated Gaussian (ε=5%) | Median RMSE(µ̂, σ̂) (x100)0.006 | 6 | |
| Joint parameter estimation | Contaminated Gaussian ε=10% | Median RMSE (µ̂, σ̂)0.0093 | 6 | |
| Joint parameter estimation | Contaminated Gaussian ε=20% | Median RMSE (µ, σ)0.0538 | 6 | |
| Parameter Estimation | Gaussian data eps=5% (synthetic) | Median MSE(sigma)3.00e-5 | 6 | |
| Parameter Estimation | Gaussian data eps=10% (synthetic) | Median MSE(sigma)0.007 | 6 | |
| Parameter Estimation | Gaussian data eps=20% (synthetic) | Median MSE(sigma)0.226 | 6 | |
| Parameter Estimation (mu) | Gaussian Distribution epsilon=5% | Median Best MSE (mu)2.00e-5 | 6 | |
| Parameter Estimation (mu) | Gaussian Distribution epsilon=10% | Median Best MSE(mu)0.6 | 6 | |
| Parameter Estimation (mu) | Gaussian Distribution epsilon=20% | Median MSE(mu)0.002 | 6 | |
| Joint parameter estimation | Contaminated Gaussian ε=0% | Median RMSE (µ, σ)0.0051 | 6 |