Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Augmentation-Free Self-Supervised Learning on Graphs

About

Inspired by the recent success of self-supervised methods applied on images, self-supervised learning on graph structured data has seen rapid growth especially centered on augmentation-based contrastive methods. However, we argue that without carefully designed augmentation techniques, augmentations on graphs may behave arbitrarily in that the underlying semantics of graphs can drastically change. As a consequence, the performance of existing augmentation-based methods is highly dependent on the choice of augmentation scheme, i.e., hyperparameters associated with augmentations. In this paper, we propose a novel augmentation-free self-supervised learning framework for graphs, named AFGRL. Specifically, we generate an alternative view of a graph by discovering nodes that share the local structural information and the global semantics with the graph. Extensive experiments towards various node-level tasks, i.e., node classification, clustering, and similarity search on various real-world datasets demonstrate the superiority of AFGRL. The source code for AFGRL is available at https://github.com/Namkyeong/AFGRL.

Namkyeong Lee, Junseok Lee, Chanyoung Park• 2021

Related benchmarks

TaskDatasetResultRank
Node ClassificationCiteseer
Accuracy68.7
1037
Node ClassificationPubmed
Accuracy79.71
902
Node ClassificationPubmed
Accuracy79.71
501
Node ClassificationPhoto
Mean Accuracy93.25
447
Node ClassificationAmazon Photo
Accuracy93.22
327
Node ClassificationPhoto
Accuracy93.25
285
Node ClassificationPhoto (test)
Mean Accuracy93.22
241
Node ClassificationComputer
Accuracy89.9
186
Node ClassificationAmazon Computers
Accuracy89.88
167
Molecular property predictionMoleculeNet BBBP (scaffold)
ROC AUC70.8
158
Showing 10 of 23 rows

Other info

Follow for update