Conformal Uncertainty Sets for Robust Optimization
About
Decision-making under uncertainty is hugely important for any decisions sensitive to perturbations in observed data. One method of incorporating uncertainty into making optimal decisions is through robust optimization, which minimizes the worst-case scenario over some uncertainty set. We connect conformal prediction regions to robust optimization, providing finite sample valid and conservative ellipsoidal uncertainty sets, aptly named conformal uncertainty sets. In pursuit of this connection we explicitly define Mahalanobis distance as a potential conformity score in full conformal prediction. We also compare the coverage and optimization performance of conformal uncertainty sets, specifically generated with Mahalanobis distance, to traditional ellipsoidal uncertainty sets on a collection of simulated robust optimization examples.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Prediction Region Estimation | Synthetic data 100 seeds (test) | Coverage99.017 | 32 | |
| Conformal Prediction | Bias | Volume1.96 | 23 | |
| Conformal Prediction | House | Volume0.0323 | 23 | |
| Conformal Prediction | CASP | Volume2.62 | 23 | |
| Conformal Prediction | RF1 | Volume89 | 22 | |
| Conformal Prediction | RF2 | Volume95 | 22 | |
| Prediction Region Estimation | Energy (test) | Coverage90.7 | 16 | |
| Conditional Coverage for Partially Revealed Outputs | CASP | ERT5.03 | 11 | |
| Conditional Coverage for Partially Revealed Outputs | taxi | ERT (%)6 | 11 | |
| Conditional Coverage for Partially Revealed Outputs | House | ERT4.18 | 11 |