Asymptotics of Entropy Rate in Special Families of Hidden Markov Chains

2008/10/13 by Guangyue Han, Han, Guangyue, Brian Marcus +1
Computer Science · Mathematics · #Cellular Automata and Applications #FOS: Computer and information sciences #Information Theory (cs.IT) #Markov Chains and Monte Carlo Methods #Mathematical Dynamics and Fractals #cs.IT #math.IT

paper · pdf · doi:10.48550/arxiv.0810.2144

16 pages

arxiv created 2008/10/13 · openalex publication_date 2008/10/13 · arxiv updated 2009/12/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We derive an asymptotic formula for entropy rate of a hidden Markov chain around a "weak Black Hole". We also discuss applications of the asymptotic formula to the asymptotic behaviors of certain channels.

Related

• Derivatives of Entropy Rate in Special Families of Hidden Markov Chains
• Entropy Rate for Hidden Markov Chains with rare transitions
• Analyticity of Entropy Rate of Hidden Markov Chains
• An efficient algorithm for the entropy rate of a hidden Markov model with unambiguous symbols
• Low and Upper Bound of Approximate Sequence for the Entropy Rate of Binary Hidden Markov Processes