GraphAlign: Pretraining One Graph Neural Network on Multiple Graphs via Feature Alignment
About
Graph self-supervised learning (SSL) holds considerable promise for mining and learning with graph-structured data. Yet, a significant challenge in graph SSL lies in the feature discrepancy among graphs across different domains. In this work, we aim to pretrain one graph neural network (GNN) on a varied collection of graphs endowed with rich node features and subsequently apply the pretrained GNN to unseen graphs. We present a general GraphAlign method that can be seamlessly integrated into the existing graph SSL framework. To align feature distributions across disparate graphs, GraphAlign designs alignment strategies of feature encoding, normalization, alongside a mixture-of-feature-expert module. Extensive experiments show that GraphAlign empowers existing graph SSL frameworks to pretrain a unified and powerful GNN across multiple graphs, showcasing performance superiority on both in-domain and out-of-domain graphs.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Node Classification | Cora (test) | Mean Accuracy52.64 | 861 | |
| Node Classification | ogbn-products (test) | Test Accuracy15.92 | 137 | |
| Edge classification | WN18RR 5 way Lexical KG (test) | Accuracy60.19 | 30 | |
| Edge classification | WN18RR 10 way Lexical KG (test) | Accuracy32.1 | 30 | |
| Edge classification | FB15K237 10 way Encyclopedic KG (test) | Accuracy77.02 | 27 | |
| Edge classification | FB15K237 40 way Encyclopedic KG (test) | Accuracy59.35 | 27 | |
| Edge classification | FB15K237 5 way Encyclopedic KG (test) | Accuracy84.92 | 27 |