Central Limit Theorem on Symmetric Kullback-Leibler (KL) Divergence

2024/01/29 by Rojas, Helder, Logachov, Artem
#FOS: Mathematics #Probability (math.PR)

paper · doi:10.48550/arxiv.2401.16524

Abstract

In this paper we provide an asymptotic theory for the symmetric version of the Kullback--Leibler (KL) divergence. We define a estimator for this divergence and study its asymptotic properties. In particular, we prove Law of Large Numbers (LLN) and the convergence to the normal law in the Central Limit Theorem (CLT) using this estimator.

Related

• New Upper bounds for KL-divergence Based on Integral Norms
• A closed-form formula for the Kullback-Leibler divergence between Cauchy distributions
• A New Lower Bound for Kullback-Leibler Divergence Based on Hammersley-Chapman-Robbins Bound
• Computing the Kullback-Leibler Divergence between two Weibull Distributions
• Symmetric KL-divergence by Stein's Method