Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SA$^{2}$GFM: Enhancing Robust Graph Foundation Models with Structure-Aware Semantic Augmentation

About

We present Graph Foundation Models (GFMs) which have made significant progress in various tasks, but their robustness against domain noise, structural perturbations, and adversarial attacks remains underexplored. A key limitation is the insufficient modeling of hierarchical structural semantics, which are crucial for generalization. In this paper, we propose SA$^{2}$GFM, a robust GFM framework that improves domain-adaptive representations through Structure-Aware Semantic Augmentation. First, we encode hierarchical structural priors by transforming entropy-based encoding trees into structure-aware textual prompts for feature augmentation. The enhanced inputs are processed by a self-supervised Information Bottleneck mechanism that distills robust, transferable representations via structure-guided compression. To address negative transfer in cross-domain adaptation, we introduce an expert adaptive routing mechanism, combining a mixture-of-experts architecture with a null expert design. For efficient downstream adaptation, we propose a fine-tuning module that optimizes hierarchical structures through joint intra- and inter-community structure learning. Extensive experiments demonstrate that SA$^{2}$GFM outperforms 9 state-of-the-art baselines in terms of effectiveness and robustness against random noise and adversarial perturbations for node and graph classification.

Junhua Shi, Qingyun Sun, Haonan Yuan, Xingcheng Fu• 2025

Related benchmarks

TaskDatasetResultRank
Node ClassificationCora
Accuracy67.2
1215
Node ClassificationCora (test)
Mean Accuracy68.4
861
Node Classificationogbn-arxiv (test)
Accuracy62.8
433
Node ClassificationPubmed
Accuracy66.4
396
Node ClassificationCiteseer
Accuracy56.8
393
Node ClassificationwikiCS
Accuracy61.5
317
Node ClassificationOgbn-arxiv
Accuracy60.8
170
Graph ClassificationPubmed
Accuracy69.9
101
Graph ClassificationCiteseer
Accuracy64
99
Graph ClassificationWiki CS
Accuracy64.6
96
Showing 10 of 39 rows

Other info

Follow for update