Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Cross-attentive Cohesive Subgraph Embedding to Mitigate Oversquashing in GNNs

About

Graph neural networks (GNNs) have achieved strong performance across various real-world domains. Nevertheless, they suffer from oversquashing, where long-range information is distorted as it is compressed through limited message-passing pathways. This bottleneck limits their ability to capture essential global context and decreases their performance, particularly in dense and heterophilic regions of graphs. To address this issue, we propose a novel graph learning framework that enriches node embeddings via cross-attentive cohesive subgraph representations to mitigate the impact of excessive long-range dependencies. This framework enhances the node representation by emphasizing cohesive structure in long-range information but removing noisy or irrelevant connections. It preserves essential global context without overloading the narrow bottlenecked channels, which further mitigates oversquashing. Extensive experiments on multiple benchmark datasets demonstrate that our model achieves consistent improvements in classification accuracy over standard baseline methods.

Tanvir Hossain, Muhammad Ifte Khairul Islam, Lilia Chebbah, Charles Fanning, Esra Akbas• 2026

Related benchmarks

TaskDatasetResultRank
Graph ClassificationPROTEINS
Accuracy71.79
994
Graph ClassificationMUTAG
Accuracy76.99
862
Graph ClassificationCOLLAB
Accuracy80.95
422
Graph ClassificationIMDB-B
Accuracy73.2
378
Graph ClassificationIMDB-M
Accuracy49.14
275
Graph ClassificationRDT-B
Accuracy85.7
83
Node ClassificationTexas (48/32/20)
Mean Accuracy54.47
78
Node ClassificationChameleon (48/32/20)
Mean Accuracy68.99
49
Node ClassificationCora (Fixed)
Accuracy85
47
Node ClassificationCiteSeer (fixed split)
Accuracy69.42
37
Showing 10 of 14 rows

Other info

Follow for update