A Tutorial on Kernel Density Estimation and Recent Advances
About
This tutorial provides a gentle introduction to kernel density estimation (KDE) and recent advances regarding confidence bands and geometric/topological features. We begin with a discussion of basic properties of KDE: the convergence rate under various metrics, density derivative estimation, and bandwidth selection. Then, we introduce common approaches to the construction of confidence intervals/bands, and we discuss how to handle bias. Next, we talk about recent advances in the inference of geometric and topological features of a density function using KDE. Finally, we illustrate how one can use KDE to estimate a cumulative distribution function and a receiver operating characteristic curve. We provide R implementations related to this tutorial at the end.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Local Probability Mass Validation | Dijet | Probability Mass (Region A)6.7234 | 4 | |
| Behavioral Anomaly Detection | Argoverse Turn left | AUROC55.2 | 4 | |
| Behavioral Anomaly Detection | Argoverse Max Velocity | AUROC70.8 | 4 | |
| Behavioral Anomaly Detection | Argoverse Turn right | AUROC56.1 | 4 | |
| Density Estimation | Muon decay 0.02 × 0.02 square regions (Region A) | Probability Mass (Region A)0.0015 | 3 | |
| Density Estimation | Muon decay 0.02 × 0.02 square regions (Region B) | Probability Mass9.17e-4 | 3 |