Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Graph Contrastive Clustering

About

Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category information and clustering objective into consideration, thus the learned representations are not optimal for clustering and the performance might be limited. Towards this issue, we first propose a novel graph contrastive learning framework, which is then applied to the clustering task and we come up with the Graph Constrastive Clustering~(GCC) method. Different from basic contrastive clustering that only assumes an image and its augmentation should share similar representation and clustering assignments, we lift the instance-level consistency to the cluster-level consistency with the assumption that samples in one cluster and their augmentations should all be similar. Specifically, on the one hand, the graph Laplacian based contrastive loss is proposed to learn more discriminative and clustering-friendly features. On the other hand, a novel graph-based contrastive learning strategy is proposed to learn more compact clustering assignments. Both of them incorporate the latent category information to reduce the intra-cluster variance while increasing the inter-cluster variance. Experiments on six commonly used datasets demonstrate the superiority of our proposed approach over the state-of-the-art methods.

Huasong Zhong, Jianlong Wu, Chong Chen, Jianqiang Huang, Minghua Deng, Liqiang Nie, Zhouchen Lin, Xian-Sheng Hua• 2021

Related benchmarks

TaskDatasetResultRank
Image ClusteringCIFAR-10
NMI0.764
243
Image ClusteringSTL-10
ACC78.8
229
ClusteringCIFAR-10 (test)
Accuracy90.1
184
Image ClusteringImageNet-10
NMI0.842
166
ClusteringSTL-10 (test)
Accuracy83.3
146
ClusteringCIFAR-100 (test)
ACC47.2
110
ClusteringCIFAR100 20
ACC47.2
93
ClusteringCIFAR-100-20 (test)
Accuracy52.3
68
GroupingImagenet Dogs
ACC52.6
59
ClusteringImagenet Dogs
NMI4.90e+3
46
Showing 10 of 13 rows

Other info

Follow for update