Hierarchical Multi-Scale Graph Neural Networks: Scalable Heterophilous Learning with Oversmoothing and Oversquashing Mitigation
About
Graphs with heterophily, where adjacent nodes carry different labels, are prevalent in real-world applications, from social networks to molecular interactions. However, existing spectral Graph Neural Network (GNN) approaches tailored for heterophilous graph classification suffer from hub-dominated (node with large degree) aggregation and oversmoothing, as their suboptimal polynomial filters introduce approximation errors and blend distant signals. To address the degree-biased aggregation and suboptimal polynomial filtering, we introduce a Hierarchical Multi-view HAAR (HMH), a novel spectral graph-learning framework that scales in near-linear time . HMH first learns feature- and structure-aware signed affinities via a heterophily-aware encoder, then constructs a soft graph hierarchy guided by these embeddings. At each hierarchical level, HMH constructs a sparse, orthonormal, and locality-aware Haar basis to apply learnable spectral filters in the frequency domain. Finally, skip-connection unpooling layers combine outputs from all hierarchical levels back into the original graph, effectively preventing hub domination and long-range signal bottleneck (over-squashing). Experimentation shows that HMH outperforms state-of-the-art spectral baselines, achieving up to a 3% improvement on node classification and 7% points on graph classification datasets, all while maintaining linear scalability.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Graph Classification | PROTEINS | Accuracy76.8 | 1252 | |
| Graph Classification | MUTAG | Accuracy94.5 | 1103 | |
| Node Classification | Citeseer | Accuracy81.5 | 1037 | |
| Node Classification | Chameleon | Accuracy41.2 | 867 | |
| Node Classification | Squirrel | Accuracy39.5 | 786 | |
| Graph Classification | NCI1 | Accuracy80.9 | 658 | |
| Graph Classification | IMDB-M | Accuracy52.5 | 425 | |
| Node Classification | Roman-Empire | Accuracy76.1 | 327 | |
| Node Classification | amazon-ratings | Accuracy48.64 | 309 | |
| Graph Classification | NCI109 | Accuracy80.7 | 267 |