Consistent Density Estimation Under Discrete Mixture Models

2021/05/03 by Luc Devroye, Devroye, Luc, Alex Dytso +1
Computer Science · Mathematics · Medicine · #Bayesian Methods and Mixture Models #Statistical Methods and Inference #Colorectal Cancer Screening and Detection

paper · pdf · doi:10.48550/arxiv.2105.01108

Abstract

This work considers a problem of estimating a mixing probability density f in the setting of discrete mixture models. The paper consists of three parts. The first part focuses on the construction of an L₁ consistent estimator of f. In particular, under the assumptions that the probability measure μ of the observation is atomic, and the map from f to μ is bijective, it is shown that there exists an estimator f_n such that for every density f lim_{n→ ∞} 𝔼 [ ∫ |f_n -f | ]=0. The second part discusses the implementation details. Specifically, it is shown that the consistency for every f can be attained with a computationally feasible estimator. The third part, as a study case, considers a Poisson mixture model. In particular, it is shown that in the Poisson noise setting, the bijection condition holds and, hence, estimation can be performed consistently for every f.

Related

• Density estimation with atoms, and functional estimation for mixed discrete-continuous data
• Bayesian Density Estimation and Inference Using Mixtures
• On approximations via convolution-defined mixture models
• Consistent Estimation of Identifiable Nonparametric Mixture Models from Grouped Observations
• Stochastic Approximation Algorithm for Estimating Mixing Distribution\n for Dependent Observations