PromptGNN-sim: Deep Fusion and Alignment of GNN and LLMs for Text-Attributed Graph Learning
About
Text-Attributed Graphs (TAGs) combine textual semantics with graph structure and are central to many graph learning tasks. However, existing fusion methods often treat text and structure as separate inputs in a shallow, one-way pipeline, which limits deep interaction between modalities and weakens performance under sparse connectivity or cross-graph generalisation. To address this issue, we propose PromptGNN-sim, a bi-directional structure-semantic fusion framework for collaborative GNN-LLM learning. PromptGNN-sim uses a Graph Attention Network (GAT) for semantically aware neighborhood selection by combining structural attention with textual similarity. The selected structural context is then used to generate structure-aware prompts for an LLM, including the target node summary, label categories, and representative keywords from similar neighbors. During training, bi-directional cross-modal contrastive learning and cross-attention are introduced to jointly optimize the GNN and LLM components. Experiments on six public datasets, including Cora, Pubmed, and WikiCS, evaluate accuracy, generalisation, and robustness under cross-task transfer, cross-dataset generalisation, and sparse perturbations. Results show that PromptGNN-sim outperforms classical GNNs, LLMs, and recent GNN-LLM fusion methods, demonstrating the effectiveness of interactive structure-semantic collaboration for text-attributed graph learning.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Node Classification | Pubmed | Accuracy94.12 | 501 | |
| Node Classification | Photo | Accuracy87.2 | 285 | |
| Node Classification | History | Accuracy84.97 | 83 | |
| Node Classification | Citeseer | Macro F177.92 | 28 | |
| Node Classification | History | Macro F151.41 | 28 | |
| Node Classification | wikiCS | Macro F183.85 | 14 | |
| Node Classification | Pubmed | Macro F1 Score93.59 | 14 | |
| Link Prediction | Cora | Accuracy (%)87.54 | 11 | |
| Link Prediction | Citeseer | Accuracy (%)86.27 | 11 | |
| Link Prediction | wikiCS | Accuracy (%)89.93 | 11 |