Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detection

About

With a long history of traditional Graph Anomaly Detection (GAD) algorithms and recently popular Graph Neural Networks (GNNs), it is still not clear (1) how they perform under a standard comprehensive setting, (2) whether GNNs can outperform traditional algorithms such as tree ensembles, and (3) how about their efficiency on large-scale graphs. In response, we introduce GADBench -- a benchmark tool dedicated to supervised anomalous node detection in static graphs. GADBench facilitates a detailed comparison across 29 distinct models on ten real-world GAD datasets, encompassing thousands to millions ($\sim$6M) nodes. Our main finding is that tree ensembles with simple neighborhood aggregation can outperform the latest GNNs tailored for the GAD task. We shed light on the current progress of GAD, setting a robust groundwork for subsequent investigations in this domain. GADBench is open-sourced at https://github.com/squareRoot3/GADBench.

Jianheng Tang, Fengrui Hua, Ziqi Gao, Peilin Zhao, Jia Li• 2023

Related benchmarks

TaskDatasetResultRank
Graph Anomaly DetectionAMAZON
AUROC94.7
65
Graph Anomaly DetectionREDDIT
AUPRC4.1
63
Graph Anomaly DetectionWeibo
AUROC96.4
42
Graph Anomaly DetectionElliptic
AUROC91.9
34
Graph Anomaly DetectionT-Finance
AUPRC78.3
32
Graph Anomaly DetectionYelpChi
AUPRC24.8
27
Graph Anomaly DetectionDGraph
AUROC0.624
26
Node Anomaly DetectionReddit (semi-supervised)
AUPRC4.5
25
Node Anomaly DetectionReddit fully-supervised
AUPRC5.6
25
Graph Anomaly DetectionGADBench
Reddit Score5.29
25
Showing 10 of 34 rows

Other info

Code

Follow for update