Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Simple and Asymmetric Graph Contrastive Learning without Augmentations

About

Graph Contrastive Learning (GCL) has shown superior performance in representation learning in graph-structured data. Despite their success, most existing GCL methods rely on prefabricated graph augmentation and homophily assumptions. Thus, they fail to generalize well to heterophilic graphs where connected nodes may have different class labels and dissimilar features. In this paper, we study the problem of conducting contrastive learning on homophilic and heterophilic graphs. We find that we can achieve promising performance simply by considering an asymmetric view of the neighboring nodes. The resulting simple algorithm, Asymmetric Contrastive Learning for Graphs (GraphACL), is easy to implement and does not rely on graph augmentations and homophily assumptions. We provide theoretical and empirical evidence that GraphACL can capture one-hop local neighborhood information and two-hop monophily similarity, which are both important for modeling heterophilic graphs. Experimental results show that the simple GraphACL significantly outperforms state-of-the-art graph contrastive learning and self-supervised learning methods on homophilic and heterophilic graphs. The code of GraphACL is available at https://github.com/tengxiao1/GraphACL.

Teng Xiao, Huaisheng Zhu, Zhengyu Chen, Suhang Wang• 2023

Related benchmarks

TaskDatasetResultRank
Graph ClassificationPROTEINS
Accuracy73.5
1252
Node ClassificationCiteseer
Accuracy73.63
1037
Node ClassificationCora (test)
Mean Accuracy84.2
951
Node ClassificationCiteseer (test)
Accuracy0.736
945
Node ClassificationChameleon
Accuracy38.59
867
Node ClassificationPubmed
Accuracy82.02
865
Node ClassificationWisconsin
Accuracy69.22
864
Node ClassificationCornell
Accuracy59.33
851
Node ClassificationTexas
Accuracy0.7108
801
Node ClassificationSquirrel
Accuracy35.51
786
Showing 10 of 41 rows

Other info

Follow for update