Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Multi-level Feature Learning for Contrastive Multi-view Clustering

About

Multi-view clustering can explore common semantics from multiple views and has attracted increasing attention. However, existing works punish multiple objectives in the same feature space, where they ignore the conflict between learning consistent common semantics and reconstructing inconsistent view-private information. In this paper, we propose a new framework of multi-level feature learning for contrastive multi-view clustering to address the aforementioned issue. Our method learns different levels of features from the raw features, including low-level features, high-level features, and semantic labels/features in a fusion-free manner, so that it can effectively achieve the reconstruction objective and the consistency objectives in different feature spaces. Specifically, the reconstruction objective is conducted on the low-level features. Two consistency objectives based on contrastive learning are conducted on the high-level features and the semantic labels, respectively. They make the high-level features effectively explore the common semantics and the semantic labels achieve the multi-view clustering. As a result, the proposed framework can reduce the adverse influence of view-private information. Extensive experiments on public datasets demonstrate that our method achieves state-of-the-art clustering effectiveness.

Jie Xu, Huayi Tang, Yazhou Ren, Liang Peng, Xiaofeng Zhu, Lifang He• 2021

Related benchmarks

TaskDatasetResultRank
ClusteringCOIL-20
ACC36.98
47
Multi-view ClusteringBDGP
ACC98.9
29
ClusteringCOIL-100
ACC35.03
28
Multi-view ClusteringSynthetic3d
ACC96.5
26
Multi-view ClusteringFashion
ACC99.2
25
ClusteringE-MNIST
Accuracy65.98
25
ClusteringHandwritten (test)
ACC64
23
ClassificationBDGP
Acc98.2
17
Multi-view ClusteringHdigit 100% aligned
Accuracy99.79
14
Multi-view ClusteringMNIST-USPS 100% aligned
ACC99.54
14
Showing 10 of 56 rows

Other info

Code

Follow for update