Localized Conformal Prediction: A Generalized Inference Framework for Conformal Prediction
About
We propose a new inference framework called localized conformal prediction. It generalizes the framework of conformal prediction by offering a single-test-sample adaptive construction that emphasizes a local region around this test sample, and can be combined with different conformal score constructions. The proposed framework enjoys an assumption-free finite sample marginal coverage guarantee, and it also offers additional local coverage guarantees under suitable assumptions. We demonstrate how to change from conformal prediction to localized conformal prediction using several conformal scores, and we illustrate a potential gain via numerical examples.
Leying Guan• 2021
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Interval Estimation | Simulated p=100 (test) | PCC0.837 | 9 | |
| Interval Estimation | Simulated p=50 (test) | PCC0.897 | 9 | |
| Interval Estimation | Simulated p=300 (test) | PCC0.617 | 9 | |
| Conformal Prediction | Diabetes eta_hat=0.67 | Coverage88.8 | 9 | |
| Regression | ILINet | Coverage90.8 | 7 | |
| Node Classification | CRA (test) | Marginal Coverage90.7 | 7 | |
| Node Classification | CBAS (test) | Marginal Coverage94.3 | 7 | |
| Node Classification | WKB (test) | Marginal Coverage93.3 | 7 | |
| Node Classification | PMD (test) | Marginal Coverage91.7 | 7 | |
| Worst-slab coverage (WSC) | CRA | WSC Coverage74 | 7 |
Showing 10 of 58 rows