Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PromptGNN-sim: Deep Fusion and Alignment of GNN and LLMs for Text-Attributed Graph Learning

About

Text-Attributed Graphs (TAGs) combine textual semantics with graph structure and are central to many graph learning tasks. However, existing fusion methods often treat text and structure as separate inputs in a shallow, one-way pipeline, which limits deep interaction between modalities and weakens performance under sparse connectivity or cross-graph generalisation. To address this issue, we propose PromptGNN-sim, a bi-directional structure-semantic fusion framework for collaborative GNN-LLM learning. PromptGNN-sim uses a Graph Attention Network (GAT) for semantically aware neighborhood selection by combining structural attention with textual similarity. The selected structural context is then used to generate structure-aware prompts for an LLM, including the target node summary, label categories, and representative keywords from similar neighbors. During training, bi-directional cross-modal contrastive learning and cross-attention are introduced to jointly optimize the GNN and LLM components. Experiments on six public datasets, including Cora, Pubmed, and WikiCS, evaluate accuracy, generalisation, and robustness under cross-task transfer, cross-dataset generalisation, and sparse perturbations. Results show that PromptGNN-sim outperforms classical GNNs, LLMs, and recent GNN-LLM fusion methods, demonstrating the effectiveness of interactive structure-semantic collaboration for text-attributed graph learning.

Zhifei Hu, Alexandra I. Cristea• 2026

Related benchmarks

TaskDatasetResultRank
Node ClassificationPubmed
Accuracy94.12
501
Node ClassificationPhoto
Accuracy87.2
285
Node ClassificationHistory
Accuracy84.97
83
Node ClassificationCiteseer
Macro F177.92
28
Node ClassificationHistory
Macro F151.41
28
Node ClassificationwikiCS
Macro F183.85
14
Node ClassificationPubmed
Macro F1 Score93.59
14
Link PredictionCora
Accuracy (%)87.54
11
Link PredictionCiteseer
Accuracy (%)86.27
11
Link PredictionwikiCS
Accuracy (%)89.93
11
Showing 10 of 11 rows

Other info

Follow for update