On Predictive Density Estimation under α-divergence Loss

2018/06/07 by L'Moudden, Aziz, Marchand, Éric
#62C20 #62C86 #62F10 #62F15 #62F30 #FOS: Mathematics #Statistics Theory (math.ST)

paper · doi:10.48550/arxiv.1806.02600

Abstract

Based on X ∼ N_d(θ, σ²_X I_d), we study the efficiency of predictive densities under α-divergence loss L_α for estimating the density of Y ∼ N_d(θ, σ²_Y I_d). We identify a large number of cases where improvement on a plug-in density are obtainable by expanding the variance, thus extending earlier findings applicable to Kullback-Leibler loss. The results and proofs are unified with respect to the dimension d, the variances σ²_X and σ²_Y, the choice of loss L_α; α∈ (-1,1). The findings also apply to a large number of plug-in densities, as well as for restricted parameter spaces with θ∈ Θ⊂ ℝ^d. The theoretical findings are accompanied by various observations, illustrations, and implications dealing for instance with robustness with respect to the model variances and simultaneous dominance with respect to the loss.

Related

• On predictive density estimation with additional information
• Predictive density estimators with integrated L₁ loss
• On Predictive Density Estimation for Location Families under Integrated L₂ and L₁ Losses
• Robust density estimation with the \mathbbL₁-loss. Applications to the estimation of a density on the line satisfying a shape constraint
• Bounds on Lp errors in density ratio estimation via f-divergence loss functions