Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GOODAT: Towards Test-time Graph Out-of-Distribution Detection

About

Graph neural networks (GNNs) have found widespread application in modeling graph data across diverse domains. While GNNs excel in scenarios where the testing data shares the distribution of their training counterparts (in distribution, ID), they often exhibit incorrect predictions when confronted with samples from an unfamiliar distribution (out-of-distribution, OOD). To identify and reject OOD samples with GNNs, recent studies have explored graph OOD detection, often focusing on training a specific model or modifying the data on top of a well-trained GNN. Despite their effectiveness, these methods come with heavy training resources and costs, as they need to optimize the GNN-based models on training data. Moreover, their reliance on modifying the original GNNs and accessing training data further restricts their universality. To this end, this paper introduces a method to detect Graph Out-of-Distribution At Test-time (namely GOODAT), a data-centric, unsupervised, and plug-and-play solution that operates independently of training data and modifications of GNN architecture. With a lightweight graph masker, GOODAT can learn informative subgraphs from test samples, enabling the capture of distinct graph patterns between OOD and ID samples. To optimize the graph masker, we meticulously design three unsupervised objective functions based on the graph information bottleneck principle, motivating the masker to capture compact yet informative subgraphs for OOD detection. Comprehensive evaluations confirm that our GOODAT method outperforms state-of-the-art benchmarks across a variety of real-world datasets. The code is available at Github: https://github.com/Ee1s/GOODAT

Luzhi Wang, Dongxiao He, He Zhang, Yixin Liu, Wenjie Wang, Shirui Pan, Di Jin, Tat-Seng Chua• 2024

Related benchmarks

TaskDatasetResultRank
Graph Out-of-Distribution DetectionBZR (ID) COX2 (OOD)
AUC0.965
49
Graph OOD DetectionIMDB-M IMDB-B
AUC0.81
36
Graph Anomaly DetectionMUTAG
AUROC0.8184
36
Graph Anomaly DetectionCOX2
AUC0.5999
33
Graph Anomaly DetectionIMDB-B
AUC65.5
33
Graph Out-of-Distribution DetectionAIDS DHFR ID OOD
AUC96.43
33
Graph Anomaly DetectionENZYMES
AUC59.1
33
Graph Anomaly DetectionNCI1
AUC45.96
33
Graph Out-of-Distribution DetectionTox21 SIDER ID OOD
AUC (%)68.92
29
Graph Out-of-Distribution DetectionENZYMES ID PROTEIN OOD
AUC (%)66.29
29
Showing 10 of 51 rows

Other info

Follow for update