2024/03/11 by Yoshikazu Terada, Terada, Yoshikazu · 2 citations
Agricultural and Biological Sciences · Chemistry · Computer Science · Mathematics · #Advanced Scientific Research Methods #Chemistry #Chromatography #Cognitive Science and Mapping #Computer science #Consistency (knowledge bases) #Cybersecurity and Information Systems #Decomposition #Discrete mathematics #FOS: Mathematics #Factor (programming language) #Mathematics #Matrix (chemical analysis) #Programming language #Statistics #Statistics Theory (math.ST)
paper · pdf · doi:10.48550/arxiv.2403.06968
published in arXiv (Cornell University) (Cornell University)
openalex publication_date 2024/03/11 · openalex created_date 2024/03/13 · openalex updated_date 2026/07/28
Numerous estimators have been proposed for factor analysis, and their statistical properties have been extensively studied. In the early 2000s, a novel matrix factorization-based approach, known as Matrix Decomposition Factor Analysis (MDFA), was introduced and has been actively developed in computational statistics. The MDFA estimator offers several advantages, including the guarantee of proper solutions (i.e., no Heywood cases) and the extensibility to ℓ0-sparse estimation. However, the MDFA estimator does not appear to be formulated as a classical M-estimator or a minimum discrepancy function (MDF) estimator, and the statistical properties of the MDFA estimator have remained largely unexplored. Although the MDFA estimator minimizes a loss function resembling that of principal component analysis (PCA), it empirically behaves more like consistent estimators used in factor analysis than like PCA itself. This raises a fundamental question: can matrix decomposition factor analysis truly be regarded as "factor analysis"? To address this issue, we establish consistency and asymptotic normality of the MDFA estimator. Recognizing that the MDFA estimator can be formulated as a semiparametric maximum likelihood estimator, we surprisingly find that the profile likelihood is given by the squared Bures-Wasserstein distance between the sample covariance matrix and the modeled covariance matrix. As a consequence, the MDFA estimator is ultimately an MDF estimator for factor analysis. Beyond MDFA, the same representation holds for a broad class of component analysis methods, including PCA, thereby offering a unified perspective on component analysis. Numerical experiments demonstrate that MDFA performs competitively with other established estimators, suggesting that it is a theoretically grounded and computationally appealing alternative for factor analysis.