Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Can Graph Foundation Models Generalize Over Architecture?

About

Graph foundation models (GFMs) have recently attracted interest due to the promise of graph neural network (GNN) architectures that generalize zero-shot across graphs of arbitrary scales, feature dimensions, and domains. While existing work has demonstrated this ability empirically across diverse real-world benchmarks, these tasks share a crucial hidden limitation: they admit a narrow set of effective GNN architectures. In particular, current domain-agnostic GFMs rely on fixed architectural backbones, implicitly assuming that a single message-passing regime suffices across tasks. In this paper, we argue that architecture adaptivity is a necessary requirement for true GFMs. We show that existing approaches are non-robust to task-dependent architectural attributes and, as a case study, use range as a minimal and measurable axis along which this limitation becomes explicit. With theoretical analysis and controlled synthetic experiments, we demonstrate that fixed-backbone GFMs provably under-reach on tasks whose architectural requirements differ from those seen at training time. To address this issue, we introduce a framework that adapts effective GNN architecture at inference time by discovering and mixing task-specific linear graph operators, enabling zero-shot generalization across tasks with heterogeneous architectural requirements, without retraining. We validate our approach on arbitrary-range synthetic tasks and a suite of real-world benchmarks, demonstrating improved performance and robustness over existing domain-agnostic GFMs.

Benjamin Gutteridge, Michael Bronstein, Xiaowen Dong• 2026

Related benchmarks

TaskDatasetResultRank
Node ClassificationChameleon
Accuracy67.37
640
Node ClassificationWisconsin
Accuracy82.35
627
Node ClassificationTexas
Accuracy0.7838
616
Node ClassificationSquirrel
Accuracy56.02
591
Node ClassificationCornell
Accuracy67.57
582
Node ClassificationActor
Accuracy25.36
397
Node ClassificationAmazon Photo
Accuracy88.9
191
Node ClassificationPubmed
Accuracy74.7
178
Node Classificationamazon-ratings
Accuracy44.44
173
Node ClassificationCiteseer
Mean Accuracy65.3
90
Showing 10 of 28 rows

Other info

Follow for update