Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

RAG-GFM: Overcoming In-Memory Bottlenecks in Graph Foundation Models via Retrieval-Augmented Generation

About

Graph Foundation Models (GFMs) have emerged as a frontier in graph learning, which are expected to deliver transferable representations across diverse tasks. However, GFMs remain constrained by in-memory bottlenecks: they attempt to encode knowledge into model parameters, which limits semantic capacity, introduces heavy lossy compression with conflicts, and entangles graph representation with the knowledge in ways that hinder efficient adaptation, undermining scalability and interpretability. In this work,we propose RAG-GFM, a Retrieval-Augmented Generation aided Graph Foundation Model that offloads knowledge from parameters and complements parameterized learning. To externalize graph knowledge, we build a dual-modal unified retrieval module, where a semantic store from prefix-structured text and a structural store from centrality-based motif. To preserve heterogeneous information, we design a dual-view alignment objective that contrasts both modalities to capture both content and relational patterns. To enable efficient downstream adaptation, we perform in-context augmentation to enrich supporting instances with retrieved texts and motifs as contextual evidence. Extensive experiments on five benchmark graph datasets demonstrate that RAG-GFM consistently outperforms 13 state-of-the-art baselines in both cross-domain node and graph classification, achieving superior effectiveness and efficiency.

Haonan Yuan, Qingyun Sun, Jiacheng Tao, Xingcheng Fu, Jianxin Li• 2026

Related benchmarks

TaskDatasetResultRank
Node ClassificationPubmed
Accuracy68.7
307
Node ClassificationCiteseer
Accuracy57.7
275
Node ClassificationwikiCS
Accuracy60.9
198
Node ClassificationOGBN-Products
Accuracy64.2
62
Node ClassificationCora
Accuracy76.1
38
Graph ClassificationPubmed
Accuracy71.5
31
Graph ClassificationCiteseer
Accuracy65.5
29
Graph ClassificationOGBN-Products
Accuracy68
26
Graph ClassificationWiki CS
Accuracy62
26
Supervised Graph ClassificationCora
Accuracy78.4
26
Showing 10 of 10 rows

Other info

Follow for update