Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Distribution Free Prediction Sets for Node Classification

About

Graph Neural Networks (GNNs) are able to achieve high classification accuracy on many important real world datasets, but provide no rigorous notion of predictive uncertainty. Quantifying the confidence of GNN models is difficult due to the dependence between datapoints induced by the graph structure. We leverage recent advances in conformal prediction to construct prediction sets for node classification in inductive learning scenarios. We do this by taking an existing approach for conformal classification that relies on \textit{exchangeable} data and modifying it by appropriately weighting the conformal scores to reflect the network structure. We show through experiments on standard benchmark datasets using popular GNN models that our approach provides tighter and better calibrated prediction sets than a naive application of conformal prediction.

Jase Clarkson• 2022

Related benchmarks

TaskDatasetResultRank
ClassificationGOOD-CBAS
WSC Prediction Length3.78
7
ClassificationPubMed (PMD)
WSC Prediction Length2.12
7
Marginal Prediction LengthPubMed (PMD)
Marginal Prediction Length2.65
7
Node ClassificationCRA (test)
Marginal Coverage98.6
7
Node ClassificationCBAS (test)
Marginal Coverage100
7
Node ClassificationWKB (test)
Marginal Coverage100
7
Node ClassificationPMD (test)
Marginal Coverage99
7
Worst-slab coverage (WSC)CRA
WSC Coverage94
7
Worst-slab coverage (WSC)CBAS
WSC Coverage100
7
Worst-slab coverage (WSC)WKB
WSC Coverage100
7
Showing 10 of 27 rows

Other info

Follow for update