Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Neighbourhood Transformer: Switchable Attention for Monophily-Aware Graph Learning

About

Graph neural networks (GNNs) have been widely adopted in engineering applications such as social network analysis, chemical research and computer vision. However, their efficacy is severely compromised by the inherent homophily assumption, which fails to hold for heterophilic graphs where dissimilar nodes are frequently connected. To address this fundamental limitation in graph learning, we first draw inspiration from the recently discovered monophily property of real-world graphs, and propose Neighbourhood Transformers (NT), a novel paradigm that applies self-attention within every local neighbourhood instead of aggregating messages to the central node as in conventional message-passing GNNs. This design makes NT inherently monophily-aware and theoretically guarantees its expressiveness is no weaker than traditional message-passing frameworks. For practical engineering deployment, we further develop a neighbourhood partitioning strategy equipped with switchable attentions, which reduces the space consumption of NT by over 95% and time consumption by up to 92.67%, significantly expanding its applicability to larger graphs. Extensive experiments on 10 real-world datasets (5 heterophilic and 5 homophilic graphs) show that NT outperforms all current state-of-the-art methods on node classification tasks, demonstrating its superior performance and cross-domain adaptability. The full implementation code of this work is publicly available at https://github.com/cf020031308/MoNT to facilitate reproducibility and industrial adoption.

Yi Luo, Xu Sun, Guangchun Luo, Aiguo Chen• 2026

Related benchmarks

TaskDatasetResultRank
Node ClassificationPhoto
Mean Accuracy96.67
343
Node ClassificationwikiCS
Accuracy80.17
317
Node ClassificationRoman-Empire
Accuracy94.77
206
Node Classificationamazon-ratings
Accuracy54.25
173
Node ClassificationMinesweeper
Accuracy97.42
55
Node ClassificationRoman-empire heterophilic (test)
Accuracy94.77
49
Node ClassificationAmazon-ratings heterophilic (test)
Accuracy54.55
49
Node ClassificationCoauthor PHY
Accuracy97.33
39
Node ClassificationCoauthorCS
Accuracy96.09
31
Node ClassificationA-Computers
Accuracy93.87
30
Showing 10 of 15 rows

Other info

Follow for update