Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networks

About

Graph neural networks (GNNs) work well when the graph structure is provided. However, this structure may not always be available in real-world applications. One solution to this problem is to infer a task-specific latent structure and then apply a GNN to the inferred graph. Unfortunately, the space of possible graph structures grows super-exponentially with the number of nodes and so the task-specific supervision may be insufficient for learning both the structure and the GNN parameters. In this work, we propose the Simultaneous Learning of Adjacency and GNN Parameters with Self-supervision, or SLAPS, a method that provides more supervision for inferring a graph structure through self-supervision. A comprehensive experimental study demonstrates that SLAPS scales to large graphs with hundreds of thousands of nodes and outperforms several models that have been proposed to learn a task-specific graph structure on established benchmarks.

Bahare Fatemi, Layla El Asri, Seyed Mehran Kazemi• 2021

Related benchmarks

TaskDatasetResultRank
Node Classificationogbn-arxiv (test)
Accuracy56.6
497
Node ClassificationIMDB
Macro F1 Score0.5789
211
Node ClassificationACM
Macro F188.51
152
Text Classification20News
Accuracy50.4
143
Node Classificationogbn-arxiv v1 (test)
Accuracy55.46
52
Node ClassificationCiteseer (standard)
Accuracy73.1
46
Node ClassificationCora (standard)
Accuracy74.2
46
ClassificationWine
Accuracy96.6
45
Network reconstructionIMDB
AUC0.499
42
Graph ReconstructionAmz-R
AUC52.3
36
Showing 10 of 30 rows

Other info

Code

Follow for update