Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

One Prompt Fits All: Universal Graph Adaptation for Pretrained Models

About

Graph Prompt Learning (GPL) has emerged as a promising paradigm that bridges graph pretraining models and downstream scenarios, mitigating label dependency and the misalignment between upstream pretraining and downstream tasks. Although existing GPL studies explore various prompt strategies, their effectiveness and underlying principles remain unclear. We identify two critical limitations: (1) Lack of consensus on underlying mechanisms: Despite current GPLs have advanced the field, there is no consensus on how prompts interact with pretrained models, as different strategies intervene at varying spaces within the model, i.e., input-level, layer-wise, and representation-level prompts. (2) Limited scenario adaptability: Most methods fail to generalize across diverse downstream scenarios, especially under data distribution shifts (e.g., homophilic-to-heterophilic graphs). To address these issues, we theoretically analyze existing GPL approaches and reveal that representation-level prompts essentially function as fine-tuning a simple downstream classifier, proposing that graph prompt learning should focus on unleashing the capability of pretrained models, and the classifier should adapt to downstream scenarios. Based on our findings, we propose UniPrompt, a novel GPL method that adapts any pretrained models, unleashing the capability of pretrained models while preserving the input graph. Extensive experiments demonstrate that our method can effectively integrate with various pretrained models and achieve strong performance across in-domain and cross-domain scenarios.

Yongqi Huang, Jitao Zhao, Dongxiao He, Xiaobao Wang, Yawen Li, Yuxiao Huang, Di Jin, Zhiyong Feng• 2025

Related benchmarks

TaskDatasetResultRank
Node ClassificationCora
Accuracy45.2
1225
Node ClassificationCiteseer
Accuracy36.51
541
Node ClassificationPhoto
Mean Accuracy70.32
447
Node ClassificationRoman-Empire
Accuracy17.52
398
Link PredictionPubmed
AUC56.32
173
Node ClassificationPhysics
Accuracy82.81
91
Node ClassificationComputers
Accuracy (%)58.24
74
Node-level classificationFacebook
Accuracy44.55
65
Node ClassificationPubmed
Mean Accuracy63.64
38
Node Classificationogbn-mag--
19
Showing 10 of 15 rows

Other info

Follow for update