Unbiased Estimators for Entropy and Class Number

2014/10/18 by Stephen Montgomery-Smith, Montgomery-Smith, Stephen, Thomas Schürmann +1 · 1 citation
Computer Science · Engineering · #FOS: Mathematics #Face and Expression Recognition #Image Processing Techniques and Applications #Statistics Theory (math.ST)

paper · pdf · doi:10.48550/arxiv.1410.5002

openalex publication_date 2014/10/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We introduce unbiased estimators for the Shannon entropy and the class number, in the situation that we are able to take sequences of independent samples of arbitrary length.

Cited by

• Estimating Semantic Alphabet Size for LLM Uncertainty Quantification

Related

• Partitioning the Sample Space for a More Precise Shannon Entropy Estimation
• Determining the Number of Samples Required to Estimate Entropy in\n Natural Sequences
• Entropy Estimates from Insufficient Samplings
• To BEE or not to BEE: Estimating more than Entropy with Biased Entropy Estimators
• On Generalized Schürmann Entropy Estimators