Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

EvenNet: Ignoring Odd-Hop Neighbors Improves Robustness of Graph Neural Networks

About

Graph Neural Networks (GNNs) have received extensive research attention for their promising performance in graph machine learning. Despite their extraordinary predictive accuracy, existing approaches, such as GCN and GPRGNN, are not robust in the face of homophily changes on test graphs, rendering these models vulnerable to graph structural attacks and with limited capacity in generalizing to graphs of varied homophily levels. Although many methods have been proposed to improve the robustness of GNN models, most of these techniques are restricted to the spatial domain and employ complicated defense mechanisms, such as learning new graph structures or calculating edge attentions. In this paper, we study the problem of designing simple and robust GNN models in the spectral domain. We propose EvenNet, a spectral GNN corresponding to an even-polynomial graph filter. Based on our theoretical analysis in both spatial and spectral domains, we demonstrate that EvenNet outperforms full-order models in generalizing across homophilic and heterophilic graphs, implying that ignoring odd-hop neighbors improves the robustness of GNNs. We conduct experiments on both synthetic and real-world datasets to demonstrate the effectiveness of EvenNet. Notably, EvenNet outperforms existing defense models against structural attacks without introducing additional computational costs and maintains competitiveness in traditional node classification tasks on homophilic and heterophilic graphs.

Runlin Lei, Zhen Wang, Yaliang Li, Bolin Ding, Zhewei Wei• 2022

Related benchmarks

TaskDatasetResultRank
Node ClassificationCora
Accuracy78.4
885
Node ClassificationCiteseer
Accuracy74.6
804
Node Classificationogbn-arxiv (test)
Accuracy64.18
382
Node ClassificationPubmed
Accuracy89.52
307
Node ClassificationCora-ML
Accuracy84.8
228
Node ClassificationCora ML (test)--
83
Node ClassificationCora (10 different splits)
Accuracy87.25
35
Node ClassificationChameleon (10 different splits)
Accuracy66.13
30
Node ClassificationTexas (10 different splits)
Accuracy93.77
27
Node ClassificationCornell (10 different splits)
Accuracy92.13
27
Showing 10 of 27 rows

Other info

Code

Follow for update