Entropies and their Asymptotic Theory in the discrete case

2019/03/19 by Amadou Diadié Ba, Ba, Amadou Diadie, Gane Samb Lô +1
Computer Science · Economics, Econometrics and Finance · Physics and Astronomy · #Complex Systems and Time Series Analysis #FOS: Mathematics #Neural Networks and Applications #Statistical Mechanics and Entropy #Statistics Theory (math.ST)

paper · pdf · doi:10.48550/arxiv.1903.08645

openalex publication_date 2019/03/19 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We present some new nonparametric estimators of entropies and we establish almost sure consistency and central limit Theorems for some of the most important entropies in the discrete case. Our theorical results are validated by simulations.

Citations

• Fuzzy Extractors: How to Generate Strong Keys from Biometrics and Other Noisy Data

Related

• Conditional Shannon, Réyni, and Tsallis entropies estimation and asymptotic limits: discrete case
• Non parametric estimation of joint, Renyi-Stallis entropies and mutual\n information and asymptotic limits
• Entropy and the Discrete Central Limit Theorem
• Additive Entropies of Partitions
• Revisiting entropies: formal properties and connections between Boltzmann-Gibbs, Tsallis and Rényi