2024/06/24 by Jyotishka Datta, Datta, Jyotishka, Ghosh, Soham +1
Engineering · #62F15 #62H25 #68T07 #FOS: Computer and information sciences #Fault Detection and Control Systems #Machine Learning (cs.LG) #Methodology (stat.ME)
paper · pdf · doi:10.48550/arxiv.2406.17058
openalex publication_date 2024/06/24 · openalex created_date 2024/06/27 · openalex updated_date 2026/07/28
Independent Component Analysis (ICA) plays a central role in modern machine learning as a flexible framework for feature extraction. We introduce a horseshoe-type prior with a latent Polya-Gamma scale mixture representation, yielding scalable algorithms for both point estimation via expectation-maximization (EM) and full posterior inference via Markov chain Monte Carlo (MCMC). This hierarchical formulation unifies several previously disparate estimation strategies within a single Bayesian framework. We also establish the first theoretical guarantees for hierarchical Bayesian ICA, including posterior contraction and local asymptotic normality results for the unmixing matrix. Comprehensive simulation studies demonstrate that our methods perform competitively with widely used ICA tools. We further discuss implementation of conditional posteriors, envelope-based optimization, and possible extensions to flow-based architectures for nonlinear feature extraction and deep learning. Finally, we outline several promising directions for future work.