Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GraphAlign: Pretraining One Graph Neural Network on Multiple Graphs via Feature Alignment

About

Graph self-supervised learning (SSL) holds considerable promise for mining and learning with graph-structured data. Yet, a significant challenge in graph SSL lies in the feature discrepancy among graphs across different domains. In this work, we aim to pretrain one graph neural network (GNN) on a varied collection of graphs endowed with rich node features and subsequently apply the pretrained GNN to unseen graphs. We present a general GraphAlign method that can be seamlessly integrated into the existing graph SSL framework. To align feature distributions across disparate graphs, GraphAlign designs alignment strategies of feature encoding, normalization, alongside a mixture-of-feature-expert module. Extensive experiments show that GraphAlign empowers existing graph SSL frameworks to pretrain a unified and powerful GNN across multiple graphs, showcasing performance superiority on both in-domain and out-of-domain graphs.

Zhenyu Hou, Haozhan Li, Yukuo Cen, Jie Tang, Yuxiao Dong• 2024

Related benchmarks

TaskDatasetResultRank
Node ClassificationCora (test)
Mean Accuracy52.64
861
Node Classificationogbn-products (test)
Test Accuracy15.92
137
Edge classificationWN18RR 5 way Lexical KG (test)
Accuracy60.19
30
Edge classificationWN18RR 10 way Lexical KG (test)
Accuracy32.1
30
Edge classificationFB15K237 10 way Encyclopedic KG (test)
Accuracy77.02
27
Edge classificationFB15K237 40 way Encyclopedic KG (test)
Accuracy59.35
27
Edge classificationFB15K237 5 way Encyclopedic KG (test)
Accuracy84.92
27
Showing 7 of 7 rows

Other info

Follow for update