Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

One-Shot Federated Conformal Prediction

About

In this paper, we introduce a conformal prediction method to construct prediction sets in a oneshot federated learning setting. More specifically, we define a quantile-of-quantiles estimator and prove that for any distribution, it is possible to output prediction sets with desired coverage in only one round of communication. To mitigate privacy issues, we also describe a locally differentially private version of our estimator. Finally, over a wide range of experiments, we show that our method returns prediction sets with coverage and length very similar to those obtained in a centralized setting. Overall, these results demonstrate that our method is particularly well-suited to perform conformal predictions in a one-shot federated learning setting.

Pierre Humbert, Batiste Le Bars, Aur\'elien Bellet, Sylvain Arlot• 2023

Related benchmarks

TaskDatasetResultRank
Conformal PredictionGAUSSIAN
Conditional Coverage100
16
Conformal PredictionAirfoil
CMC (%)1.6
16
Conformal PredictionCrime
CMC1.57
16
Conformal PredictionConcrete
Conditional Marginal Coverage3.37
16
Conformal PredictionBIKE
Empirical Coverage88.2
12
Conformal PredictionCIFAR10C
Mean Coverage (MC)89.4
8
Conformal PredictionPROTEIN
MC90.2
8
Uncertainty-bound predictionPoisson
MC (%)89.97
8
Conformal PredictionCIFAR-10-C
CCC62.4
8
Conformal PredictionSTAR
MC (%)88.78
8
Showing 10 of 11 rows

Other info

Follow for update