Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Revisiting Graph Autoencoders as Implicit Contrastive Learners

About

Graph autoencoders (GAEs) and graph contrastive learning (GCL) are two major paradigms for self-supervised representation learning on graphs, yet they are often studied in isolation and treated as fundamentally different approaches. In this work, we revisit GAEs through the lens of contrastive learning and show that both structure-based and feature-based GAEs can be conceptualized as implicitly graph contrastive learners. This perspective reveals that many existing GAEs differ primarily in how contrastive views are constructed, rather than in their learning objectives or architectures. Building on this insight, we introduce a unified formulation that highlights contrastive view design as a central and previously less explored dimension in GAEs. In particular, we identify asymmetric contrastive views, arising from mismatches in subgraph views, as an important yet underexplored design axis in prior GAE research. We formalize this insight within a unified framework and conduct systematic experiments on representative graph learning tasks to examine its impact on performance and efficiency. Our results show that interpreting GAEs as implicit contrastive learners offers a clearer understanding of existing models and provides practical guidance for designing effective and scalable graph autoencoders.

Jintang Li, Ruofan Wu, Yuchang Zhu, Huizhe Zhang, Zulun Zhu, Liang Chen• 2024

Related benchmarks

TaskDatasetResultRank
Graph ClassificationPROTEINS
Accuracy77.2
1252
Graph ClassificationMUTAG
Accuracy90.5
1103
Graph ClassificationNCI1
Accuracy81.5
658
Node Classificationogbn-arxiv (test)
Accuracy71.9
497
Graph ClassificationCOLLAB
Accuracy82.3
469
Graph ClassificationIMDB-M
Accuracy52.7
425
Node ClassificationPhoto
Accuracy93.5
254
Node ClassificationPhysics
Accuracy95.8
205
Node ClusteringCora
NMI59
168
Node Classificationogbn-products (test)
Test Accuracy82.3
162
Showing 10 of 33 rows

Other info

Follow for update