Imputation-free and Alignment-free: Incomplete Multi-view Clustering Driven by Consensus Semantic Learning
About
In incomplete multi-view clustering (IMVC), missing data induce prototype shifts within views and semantic inconsistencies across views. A feasible solution is to explore cross-view consistency in paired complete observations, further imputing and aligning the similarity relationships inherently shared across views. Nevertheless, existing methods are constrained by two-tiered limitations: (1) Neither instance- nor cluster-level consistency learning construct a semantic space shared across views to learn consensus semantics. The former enforces cross-view instances alignment, and wrongly regards unpaired observations with semantic consistency as negative pairs; the latter focuses on cross-view cluster counterparts while coarsely handling fine-grained intra-cluster relationships within views. (2) Excessive reliance on consistency results in unreliable imputation and alignment without incorporating view-specific cluster information. Thus, we propose an IMVC framework, imputation- and alignment-free for consensus semantics learning (FreeCSL). To bridge semantic gaps across all observations, we learn consensus prototypes from available data to discover a shared space, where semantically similar observations are pulled closer for consensus semantics learning. To capture semantic relationships within specific views, we design a heuristic graph clustering based on modularity to recover cluster structure with intra-cluster compactness and inter-cluster separation for cluster semantics enhancement. Extensive experiments demonstrate, compared to state-of-the-art competitors, FreeCSL achieves more confident and robust assignments on IMVC task.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Clustering | DHA | Accuracy74.7 | 91 | |
| Multi-view Clustering | LandUse-21 | ACC25.9 | 69 | |
| Clustering | LandUse-21 | Accuracy26.8 | 63 | |
| Multi-view Clustering | aloi | Accuracy89.4 | 43 | |
| Clustering | ProteinFold | Accuracy24.2 | 42 | |
| Multi-view Clustering | DHA | Accuracy77.4 | 39 | |
| Multi-view Clustering | ProteinFold | Accuracy25.4 | 39 | |
| Multi-view Clustering | NoisyMNIST | Accuracy99.13 | 34 | |
| Clustering | Handwritten (test) | ACC81.85 | 23 | |
| Multi-view Clustering | ALOI 100 | ACC91.13 | 14 |