vix.ing · top · new · best · stats · spec

High-Dimensional Covariate-Augmented Overdispersed Poisson Factor Model

2024/02/23 by Wei Liu, Liu, Wei, Qingzhi Zhong +1 · 2 citations
Environmental Science · #Air Quality Monitoring and Forecasting #FOS: Computer and information sciences #Methodology (stat.ME) #Wind and Air Flow Studies

paper · pdf · doi:10.48550/arxiv.2402.15071

openalex publication_date 2024/02/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The current Poisson factor models often assume that the factors are unknown, which overlooks the explanatory potential of certain observable covariates. This study focuses on high dimensional settings, where the number of the count response variables and/or covariates can diverge as the sample size increases. A covariate-augmented overdispersed Poisson factor model is proposed to jointly perform a high-dimensional Poisson factor analysis and estimate a large coefficient matrix for overdispersed count data. A group of identifiability conditions are provided to theoretically guarantee computational identifiability. We incorporate the interdependence of both response variables and covariates by imposing a low-rank constraint on the large coefficient matrix. To address the computation challenges posed by nonlinearity, two high-dimensional latent matrices, and the low-rank constraint, we propose a novel variational estimation scheme that combines Laplace and Taylor approximations. We also develop a criterion based on a singular value ratio to determine the number of factors and the rank of the coefficient matrix. Comprehensive simulation studies demonstrate that the proposed method outperforms the state-of-the-art methods in estimation accuracy and computational efficiency. The practical merit of our method is demonstrated by an application to the CITE-seq dataset. A flexible implementation of our proposed method is available in the R package COAP.

Cited by

Related