Can Graph Foundation Models Generalize Over Architecture?
About
Graph foundation models (GFMs) have recently attracted interest due to the promise of graph neural network (GNN) architectures that generalize zero-shot across graphs of arbitrary scales, feature dimensions, and domains. While existing work has demonstrated this ability empirically across diverse real-world benchmarks, these tasks share a crucial hidden limitation: they admit a narrow set of effective GNN architectures. In particular, current domain-agnostic GFMs rely on fixed architectural backbones, implicitly assuming that a single message-passing regime suffices across tasks. In this paper, we argue that architecture adaptivity is a necessary requirement for true GFMs. We show that existing approaches are non-robust to task-dependent architectural attributes and, as a case study, use range as a minimal and measurable axis along which this limitation becomes explicit. With theoretical analysis and controlled synthetic experiments, we demonstrate that fixed-backbone GFMs provably under-reach on tasks whose architectural requirements differ from those seen at training time. To address this issue, we introduce a framework that adapts effective GNN architecture at inference time by discovering and mixing task-specific linear graph operators, enabling zero-shot generalization across tasks with heterogeneous architectural requirements, without retraining. We validate our approach on arbitrary-range synthetic tasks and a suite of real-world benchmarks, demonstrating improved performance and robustness over existing domain-agnostic GFMs.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Node Classification | Chameleon | Accuracy67.37 | 640 | |
| Node Classification | Wisconsin | Accuracy82.35 | 627 | |
| Node Classification | Texas | Accuracy0.7838 | 616 | |
| Node Classification | Squirrel | Accuracy56.02 | 591 | |
| Node Classification | Cornell | Accuracy67.57 | 582 | |
| Node Classification | Actor | Accuracy25.36 | 397 | |
| Node Classification | Amazon Photo | Accuracy88.9 | 191 | |
| Node Classification | Pubmed | Accuracy74.7 | 178 | |
| Node Classification | amazon-ratings | Accuracy44.44 | 173 | |
| Node Classification | Citeseer | Mean Accuracy65.3 | 90 |