2019/01/10 by Jian Shi, Jian Qing Shi, Shi, Jian +6
Computer Science · Engineering · Mathematics · #Bayesian Methods and Mixture Models #Control Systems and Identification #FOS: Mathematics #Statistical Methods and Inference #Statistics Theory (math.ST) #math.ST #stat.TH
paper · pdf · doi:10.48550/arxiv.1901.03269
arxiv created 2019/01/10 · openalex publication_date 2019/01/10 · arxiv updated 2019/01/11 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/01
Density estimation plays a fundamental role in many areas of statistics and machine learning. Parametric, nonparametric and semiparametric density estimation methods have been proposed in the literature. Semiparametric density models are flexible in incorporating domain knowledge and uncertainty regarding the shape of the density function. Existing literature on semiparametric density models is scattered and lacks a systematic framework. In this paper, we consider a unified framework based on the reproducing kernel Hilbert space for modeling, estimation, computation and theory. We propose general semiparametric density models for both a single sample and multiple samples which include many existing semiparametric density models as special cases. We develop penalized likelihood based estimation methods and computational methods under different situations. We establish joint consistency and derive convergence rates of the proposed estimators for both the finite dimensional Euclidean parameters and an infinite-dimensional functional parameter. We validate our estimation methods empirically through simulations and an application.