Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

OpenGraph: Towards Open Graph Foundation Models

About

Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving performance in tasks like link prediction and node classification. However, a key challenge remains: the difficulty of generalizing to unseen graph data with different properties. In this work, we propose a novel graph foundation model, called OpenGraph, to address this challenge. Our approach tackles several technical obstacles. Firstly, we enhance data augmentation using a large language model (LLM) to overcome data scarcity in real-world scenarios. Secondly, we introduce a unified graph tokenizer that enables the model to generalize effectively to diverse graph data, even when encountering unseen properties during training. Thirdly, our developed scalable graph transformer captures node-wise dependencies within the global topological context. Extensive experiments validate the effectiveness of our framework. By adapting OpenGraph to new graph characteristics and comprehending diverse graphs, our approach achieves remarkable zero-shot graph learning performance across various settings. We release the model implementation at https://github.com/HKUDS/OpenGraph.

Lianghao Xia, Ben Kao, Chao Huang• 2024

Related benchmarks

TaskDatasetResultRank
Node ClassificationPubmed
Accuracy58.4
627
Node ClassificationCiteseer
Accuracy58.58
51
Binary Classificationtolokers 2 (RL (Random Low))
AP40.38
21
Binary Classificationcity-reviews (RL)
Average Precision59.09
21
Aggregate RankingGraphLand Suite Aggregate (RL (Random Low))
AR (cls)17
19
Binary Classificationartnet-exp (RL Random Low)
AP0.1516
19
Node ClassificationWiki-CS 10%/10%/80% split
Accuracy75.66
18
Node Classificationpubmed 10%/10%/80% split
Accuracy70.3
18
Node Classificationfacebook (10%/10%/80% split)
Accuracy75.27
18
Node Classificationamazon-ratings 10%/10%/80%
Average Precision29.36
18
Showing 10 of 11 rows

Other info

Follow for update