Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

GOODAT: Towards Test-time Graph Out-of-Distribution Detection

About

Graph neural networks (GNNs) have found widespread application in modeling graph data across diverse domains. While GNNs excel in scenarios where the testing data shares the distribution of their training counterparts (in distribution, ID), they often exhibit incorrect predictions when confronted with samples from an unfamiliar distribution (out-of-distribution, OOD). To identify and reject OOD samples with GNNs, recent studies have explored graph OOD detection, often focusing on training a specific model or modifying the data on top of a well-trained GNN. Despite their effectiveness, these methods come with heavy training resources and costs, as they need to optimize the GNN-based models on training data. Moreover, their reliance on modifying the original GNNs and accessing training data further restricts their universality. To this end, this paper introduces a method to detect Graph Out-of-Distribution At Test-time (namely GOODAT), a data-centric, unsupervised, and plug-and-play solution that operates independently of training data and modifications of GNN architecture. With a lightweight graph masker, GOODAT can learn informative subgraphs from test samples, enabling the capture of distinct graph patterns between OOD and ID samples. To optimize the graph masker, we meticulously design three unsupervised objective functions based on the graph information bottleneck principle, motivating the masker to capture compact yet informative subgraphs for OOD detection. Comprehensive evaluations confirm that our GOODAT method outperforms state-of-the-art benchmarks across a variety of real-world datasets. The code is available at Github: https://github.com/Ee1s/GOODAT

Luzhi Wang, Dongxiao He, He Zhang, Yixin Liu, Wenjie Wang, Shirui Pan, Di Jin, Tat-Seng Chua• 2024

Related benchmarks

TaskDatasetResultRank
Graph Anomaly DetectionMUTAG
AUROC0.8184
23
Graph Out-of-Distribution DetectionAIDS DHFR ID OOD
AUC96.43
13
Graph Out-of-Distribution DetectionENZYMES ID PROTEIN OOD
AUC (%)66.29
13
Graph Out-of-Distribution DetectionTox21 SIDER ID OOD
AUC (%)68.92
13
Graph Out-of-Distribution DetectionFreeSolv ID ToxCast OOD
AUC0.6883
13
Graph Out-of-Distribution DetectionClinTox ID LIPO OOD
AUC0.6246
13
Graph Out-of-Distribution DetectionEsol MUV ID OOD
AUC0.8591
13
Graph Out-of-Distribution DetectionBZR (ID) COX2 (OOD)
AUC0.8216
13
Graph Anomaly Detectionp53
AUC63.27
9
Graph Anomaly DetectionDD
AUC (%)77.62
9
Showing 10 of 21 rows

Other info

Follow for update