Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detection

About

With a long history of traditional Graph Anomaly Detection (GAD) algorithms and recently popular Graph Neural Networks (GNNs), it is still not clear (1) how they perform under a standard comprehensive setting, (2) whether GNNs can outperform traditional algorithms such as tree ensembles, and (3) how about their efficiency on large-scale graphs. In response, we introduce GADBench -- a benchmark tool dedicated to supervised anomalous node detection in static graphs. GADBench facilitates a detailed comparison across 29 distinct models on ten real-world GAD datasets, encompassing thousands to millions ($\sim$6M) nodes. Our main finding is that tree ensembles with simple neighborhood aggregation can outperform the latest GNNs tailored for the GAD task. We shed light on the current progress of GAD, setting a robust groundwork for subsequent investigations in this domain. GADBench is open-sourced at https://github.com/squareRoot3/GADBench.

Jianheng Tang, Fengrui Hua, Ziqi Gao, Peilin Zhao, Jia Li• 2023

Related benchmarks

TaskDatasetResultRank
Node Anomaly DetectionReddit (semi-supervised)
AUPRC4.5
25
Node Anomaly DetectionReddit fully-supervised
AUPRC5.6
25
Graph Anomaly DetectionGADBench
Reddit Score5.29
25
Node Anomaly DetectionAmazon semi-supervised
AUPRC84.4
10
Node Anomaly DetectionYelp (semi-supervised)
AUPRC24.84
10
Node Anomaly DetectionAmazon Fully-Supervised
AUROC98.69
7
Node Anomaly DetectionYelp Fully-Supervised
AUROC96.22
7
Node Anomaly DetectionElliptic Inductive
AUROC (%)90.36
5
Node Anomaly DetectionElliptic (Transductive)
AUROC96.8
5
Node Anomaly DetectionT-Social fully-supervised
AUPRC93.8
5
Showing 10 of 19 rows

Other info

Code

Follow for update