2018/12/05 by Jielei Chu, Hongjun Wang, Chu, Jielei +7 · 1 citation
Computer Science · Mathematics · #Advanced Clustering Algorithms Research #Artificial intelligence #Cluster analysis #Computer science #Correlation clustering #FOS: Computer and information sciences #Face and Expression Recognition #Feature (linguistics) #Feature learning #Fuzzy clustering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine learning #Pattern recognition (psychology) #Text and Document Classification Technologies #Unsupervised learning #cs.LG #stat.ML
paper · pdf · doi:10.48550/arxiv.1812.01967
published in arXiv (Cornell University) (Cornell University)
openalex publication_date 2018/12/05 · arxiv created 2020/04/02 · arxiv updated 2020/04/03 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05
In this paper, we present a novel unsupervised feature learning architecture, which consists of a multi-clustering integration module and a variant of RBM termed multi-clustering integration RBM (MIRBM). In the multi-clustering integration module, we apply three unsupervised K-means, affinity propagation and spectral clustering algorithms to obtain three different clustering partitions (CPs) without any background knowledge or label. Then, an unanimous voting strategy is used to generate a local clustering partition (LCP). The novel MIRBM model is a core feature encoding part of the proposed unsupervised feature learning architecture. The novelty of it is that the LCP as an unsupervised guidance is integrated into one step contrastive divergence (CD1) learning to guide the distribution of the hidden layer features. For the instance in the same LCP cluster, the hidden and reconstructed hidden layer features of the MIRBM model in the proposed architecture tend to constrict together in the training process. Meanwhile, each LCP center tends to disperse from each other as much as possible in the hidden and reconstructed hidden layer during training. The experiments demonstrate that the proposed unsupervised feature learning architecture has more powerful feature representation and generalization capability than the state-of-the-art graph regularized RBM (GraphRBM) for clustering tasks in the Microsoft Research Asia Multimedia (MSRA-MM)2.0 dataset.