Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

A Complete Expressiveness Hierarchy for Subgraph GNNs via Subgraph Weisfeiler-Lehman Tests

About

Recently, subgraph GNNs have emerged as an important direction for developing expressive graph neural networks (GNNs). While numerous architectures have been proposed, so far there is still a limited understanding of how various design paradigms differ in terms of expressive power, nor is it clear what design principle achieves maximal expressiveness with minimal architectural complexity. To address these fundamental questions, this paper conducts a systematic study of general node-based subgraph GNNs through the lens of Subgraph Weisfeiler-Lehman Tests (SWL). Our central result is to build a complete hierarchy of SWL with strictly growing expressivity. Concretely, we prove that any node-based subgraph GNN falls into one of the six SWL equivalence classes, among which $\mathsf{SSWL}$ achieves the maximal expressive power. We also study how these equivalence classes differ in terms of their practical expressiveness such as encoding graph distance and biconnectivity. Furthermore, we give a tight expressivity upper bound of all SWL algorithms by establishing a close relation with localized versions of WL and Folklore WL (FWL) tests. Our results provide insights into the power of existing subgraph GNNs, guide the design of new architectures, and point out their limitations by revealing an inherent gap with the 2-FWL test. Finally, experiments demonstrate that $\mathsf{SSWL}$-inspired subgraph GNNs can significantly outperform prior architectures on multiple benchmarks despite great simplicity.

Bohang Zhang, Guhao Feng, Yiheng Du, Di He, Liwei Wang• 2023

Related benchmarks

TaskDatasetResultRank
Graph RegressionZINC 12K (test)
MAE0.07
164
Molecular property predictionQM9
Cv0.1083
70
Graph property predictionOGBG-MOLHIV (test)
ROC-AUC79.58
61
Graph ClassificationCSL (test)
Mean Accuracy100
45
Molecular property predictionMolHIV
ROC-AUC79.58
35
Graph ClassificationEXP (test)
Accuracy100
33
Graph RegressionZINC-FULL (250k graphs) v1 (test)
MAE0.022
16
Graph property predictionZINC v1 (test)
MAE0.07
15
Graph DistinguishabilityBREC 1.0 (test)
Basic Score60
10
Graph ClassificationSR25 (test)
Accuracy6.7
8
Showing 10 of 12 rows

Other info

Follow for update