Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Hierarchical Multi-Scale Graph Neural Networks: Scalable Heterophilous Learning with Oversmoothing and Oversquashing Mitigation

About

Graphs with heterophily, where adjacent nodes carry different labels, are prevalent in real-world applications, from social networks to molecular interactions. However, existing spectral Graph Neural Network (GNN) approaches tailored for heterophilous graph classification suffer from hub-dominated (node with large degree) aggregation and oversmoothing, as their suboptimal polynomial filters introduce approximation errors and blend distant signals. To address the degree-biased aggregation and suboptimal polynomial filtering, we introduce a Hierarchical Multi-view HAAR (HMH), a novel spectral graph-learning framework that scales in near-linear time . HMH first learns feature- and structure-aware signed affinities via a heterophily-aware encoder, then constructs a soft graph hierarchy guided by these embeddings. At each hierarchical level, HMH constructs a sparse, orthonormal, and locality-aware Haar basis to apply learnable spectral filters in the frequency domain. Finally, skip-connection unpooling layers combine outputs from all hierarchical levels back into the original graph, effectively preventing hub domination and long-range signal bottleneck (over-squashing). Experimentation shows that HMH outperforms state-of-the-art spectral baselines, achieving up to a 3% improvement on node classification and 7% points on graph classification datasets, all while maintaining linear scalability.

Md Sazzad Hossen, Avimanyu Sahoo• 2026

Related benchmarks

TaskDatasetResultRank
Graph ClassificationPROTEINS
Accuracy76.8
1383
Graph ClassificationMUTAG
Accuracy94.5
1229
Node ClassificationCiteseer
Accuracy81.5
1037
Node ClassificationChameleon
Accuracy41.2
936
Node ClassificationSquirrel
Accuracy39.5
815
Graph ClassificationNCI1
Accuracy80.9
707
Graph ClassificationIMDB-M
Accuracy52.5
434
Node ClassificationRoman-Empire
Accuracy76.1
398
Node Classificationamazon-ratings
Accuracy48.64
354
Graph ClassificationNCI109
Accuracy80.7
275
Showing 10 of 20 rows

Other info

Follow for update