Localized Conformal Prediction: A Generalized Inference Framework for Conformal Prediction
About
We propose a new inference framework called localized conformal prediction. It generalizes the framework of conformal prediction by offering a single-test-sample adaptive construction that emphasizes a local region around this test sample, and can be combined with different conformal score constructions. The proposed framework enjoys an assumption-free finite sample marginal coverage guarantee, and it also offers additional local coverage guarantees under suitable assumptions. We demonstrate how to change from conformal prediction to localized conformal prediction using several conformal scores, and we illustrate a potential gain via numerical examples.
Leying Guan• 2021
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Conformal Prediction | VentricularVolume (OUT) | Interval Width4.544 | 35 | |
| Image Regression | UTKFaces In-distribution | Interval Width2.805 | 28 | |
| Regression | VentricularVolume (in-distribution) | Interval Width2.321 | 28 | |
| Image Regression | UTKFaces Out-of-distribution | Interval Width7.558 | 28 | |
| Prediction interval computation | Airfoil (c=0) | Trials per Second42.84 | 9 | |
| Interval Estimation | Simulated p=100 (test) | PCC0.837 | 9 | |
| Prediction interval computation | Concrete tabular c=0 | Throughput (trials/s)45.74 | 9 | |
| Interval Estimation | Simulated p=50 (test) | PCC0.897 | 9 | |
| Interval Estimation | Simulated p=300 (test) | PCC0.617 | 9 | |
| Prediction interval computation | Facebook 1 tabular (c=0) | Throughput (trials/s)4.11 | 9 |
Showing 10 of 75 rows
...