OpenGraph: Towards Open Graph Foundation Models
About
Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving performance in tasks like link prediction and node classification. However, a key challenge remains: the difficulty of generalizing to unseen graph data with different properties. In this work, we propose a novel graph foundation model, called OpenGraph, to address this challenge. Our approach tackles several technical obstacles. Firstly, we enhance data augmentation using a large language model (LLM) to overcome data scarcity in real-world scenarios. Secondly, we introduce a unified graph tokenizer that enables the model to generalize effectively to diverse graph data, even when encountering unseen properties during training. Thirdly, our developed scalable graph transformer captures node-wise dependencies within the global topological context. Extensive experiments validate the effectiveness of our framework. By adapting OpenGraph to new graph characteristics and comprehending diverse graphs, our approach achieves remarkable zero-shot graph learning performance across various settings. We release the model implementation at https://github.com/HKUDS/OpenGraph.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Node Classification | Pubmed | Accuracy58.4 | 627 | |
| Node Classification | Citeseer | Accuracy58.58 | 51 | |
| Binary Classification | tolokers 2 (RL (Random Low)) | AP40.38 | 21 | |
| Binary Classification | city-reviews (RL) | Average Precision59.09 | 21 | |
| Aggregate Ranking | GraphLand Suite Aggregate (RL (Random Low)) | AR (cls)17 | 19 | |
| Binary Classification | artnet-exp (RL Random Low) | AP0.1516 | 19 | |
| Node Classification | Wiki-CS 10%/10%/80% split | Accuracy75.66 | 18 | |
| Node Classification | pubmed 10%/10%/80% split | Accuracy70.3 | 18 | |
| Node Classification | facebook (10%/10%/80% split) | Accuracy75.27 | 18 | |
| Node Classification | amazon-ratings 10%/10%/80% | Average Precision29.36 | 18 |