Empirical entropy in context

2007/08/15 by Travis Gagie, Gagie, Travis
Computer Science · #Computability, Logic, AI Algorithms #Algorithms and Data Compression #Cellular Automata and Applications

paper · pdf · doi:10.48550/arxiv.0708.2084

Abstract

We trace the history of empirical entropy, touching briefly on its relation to Markov processes, normal numbers, Shannon entropy, the Chomsky hierarchy, Kolmogorov complexity, Ziv-Lempel compression, de Bruijn sequences and stochastic complexity.

Citations

• An analysis of the Burrows—Wheeler transform
• Self-adjusting binary search trees
• Indexing compressed text

Related

• On Empirical Entropy
• A Light Discussion and Derivation of Entropy
• Shannon's entropy and its Generalizations towards Statistics, Reliability and Information Science during 1948-2018
• Researchers in an Entropy Wonderland: A Review of the Entropy Concept
• What entropy really is : the contribution of information theory