Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Hypergraph Self-supervised Learning with Sampling-efficient Signals

About

Self-supervised learning (SSL) provides a promising alternative for representation learning on hypergraphs without costly labels. However, existing hypergraph SSL models are mostly based on contrastive methods with the instance-level discrimination strategy, suffering from two significant limitations: (1) They select negative samples arbitrarily, which is unreliable in deciding similar and dissimilar pairs, causing training bias. (2) They often require a large number of negative samples, resulting in expensive computational costs. To address the above issues, we propose SE-HSSL, a hypergraph SSL framework with three sampling-efficient self-supervised signals. Specifically, we introduce two sampling-free objectives leveraging the canonical correlation analysis as the node-level and group-level self-supervised signals. Additionally, we develop a novel hierarchical membership-level contrast objective motivated by the cascading overlap relationship in hypergraphs, which can further reduce membership sampling bias and improve the efficiency of sample utilization. Through comprehensive experiments on 7 real-world hypergraphs, we demonstrate the superiority of our approach over the state-of-the-art method in terms of both effectiveness and efficiency.

Fan Li, Xiaoyang Wang, Dawei Cheng, Wenjie Zhang, Ying Zhang, Xuemin Lin• 2024

Related benchmarks

TaskDatasetResultRank
Node ClassificationCiteseer
Accuracy65.83
1037
Node ClassificationPhoto
Accuracy51.8
254
Node ClassificationComputers
Accuracy41.63
145
Node ClusteringCiteseer
NMI43.8
140
Node ClassificationCora
Accuracy64.3
134
Node ClassificationHistory
Accuracy74.88
29
Hyperedge predictionCiteseer
Accuracy73.09
18
Hyperedge predictionCora
Accuracy65.86
18
Hyperedge predictionPhoto
Accuracy71.27
15
Hyperedge predictionComputers
Accuracy71.19
15
Showing 10 of 18 rows

Other info

Follow for update