Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detection

About

With a long history of traditional Graph Anomaly Detection (GAD) algorithms and recently popular Graph Neural Networks (GNNs), it is still not clear (1) how they perform under a standard comprehensive setting, (2) whether GNNs can outperform traditional algorithms such as tree ensembles, and (3) how about their efficiency on large-scale graphs. In response, we introduce GADBench -- a benchmark tool dedicated to supervised anomalous node detection in static graphs. GADBench facilitates a detailed comparison across 29 distinct models on ten real-world GAD datasets, encompassing thousands to millions ($\sim$6M) nodes. Our main finding is that tree ensembles with simple neighborhood aggregation can outperform the latest GNNs tailored for the GAD task. We shed light on the current progress of GAD, setting a robust groundwork for subsequent investigations in this domain. GADBench is open-sourced at https://github.com/squareRoot3/GADBench.

Jianheng Tang, Fengrui Hua, Ziqi Gao, Peilin Zhao, Jia Li• 2023

Related benchmarks

TaskDatasetResultRank
Graph Anomaly DetectionAMAZON
AUROC94.7
109
Graph Anomaly DetectionREDDIT
AUROC59.2
106
Graph Anomaly DetectionWeibo
AUROC96.4
99
Graph Anomaly Detectionquestions
AUPRC7.7
59
Graph Anomaly DetectionYelpChi--
49
Graph Anomaly DetectionT-Finance
AUPRC78.3
44
Graph Anomaly DetectionElliptic
AUROC91.9
39
Graph Anomaly DetectionYelp
AUROC64
33
Graph Anomaly DetectionDGraph
AUROC0.624
31
Node Anomaly DetectionReddit (semi-supervised)
AUPRC4.5
25
Showing 10 of 34 rows

Other info

Code

Follow for update