Modeling Score Approximation Errors in Diffusion Models via Forward SPDEs
About
This study investigates the dynamics of Score-based Generative Models (SGMs) by treating the score estimation error as a stochastic source driving the Fokker-Planck equation. Departing from particle-centric SDE analyses, we employ an SPDE framework to model the evolution of the probability density field under stochastic drift perturbations. Under a simplified setting, we utilize this framework to interpret the robustness of generative models through the lens of geometric stability and displacement convexity. Furthermore, we introduce a candidate evaluation metric derived from the quadratic variation of the SPDE solution projected onto a radial test function. Preliminary observations suggest that this metric remains effective using only the initial 10% of the sampling trajectory, indicating a potential for computational efficiency.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Metric Correlation Analysis | CIFAR-10 and LSUN Timesteps 0-999 Averaged over 5 runs across 36 model configurations (Full trajectory) | L2 Norm of Mean (||mu_t||_2)0.00e+0 | 8 | |
| Metric Correlation Analysis | CIFAR-10 and LSUN Timesteps 900-999 Initial denoising stages | L2 Norm (mu_t)0.00e+0 | 8 |