Unsupervised Feature Selection based on Adaptive Similarity Learning and Subspace Clustering
About
Feature selection methods have an important role on the readability of data and the reduction of complexity of learning algorithms. In recent years, a variety of efforts are investigated on feature selection problems based on unsupervised viewpoint due to the laborious labeling task on large datasets. In this paper, we propose a novel approach on unsupervised feature selection initiated from the subspace clustering to preserve the similarities by representation learning of low dimensional subspaces among the samples. A self-expressive model is employed to implicitly learn the cluster similarities in an adaptive manner. The proposed method not only maintains the sample similarities through subspace clustering, but it also captures the discriminative information based on a regularized regression model. In line with the convergence analysis of the proposed method, the experimental results on benchmark datasets demonstrate the effectiveness of our approach as compared with the state of the art methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Feature Selection | Synthetic 2000x30-5 +15NF | Mean Correct Feature Proportion99 | 8 | |
| Feature Selection | 1000x4-3 +2NF synthetic | Mean Proportion Correct35 | 8 | |
| Feature Selection | Synthetic 1000x10-3 +5NF | Mean Correct Feature Proportion49 | 8 | |
| Feature Selection | Synthetic 2000x20-5 +10NF | Mean Selection Rate64 | 8 | |
| Feature Selection | 2NF synthetic 1000x4-5 | Mean Correct Features Proportion33 | 8 | |
| Feature Selection | Synthetic 1000x4-10 +2NF | Mean Selection Proportion33 | 8 | |
| Feature Selection | 1000x10-5 +5NF synthetic | Mean Proportion Correct Features35 | 8 | |
| Feature Selection | 1000x10-10 +5NF synthetic | Mean Proportion Correct33 | 8 | |
| Feature Selection | Synthetic 2000x20-10 +10NF | Mean Proportion Correct33 | 8 | |
| Feature Selection | Synthetic 2000x20-20 +10NF | Mean Correct Feature Proportion33 | 8 |