Merging and stability for time inhomogeneous finite Markov chains

2010/04/14 by Laurent Saloff-Coste, Saloff-Coste, Laurent, Jessica Zuniga +1
Mathematics · #FOS: Mathematics #Probability (math.PR) #math.PR

paper · pdf · doi:10.48550/arxiv.1004.2296

arxiv created 2010/04/14 · arxiv updated 2010/04/15

Abstract

We discuss problems posed by the quantitative study of time inhomogeneous Markov chains. The two main notions for our purpose are merging and stability. Merging (also called weak ergodicity) occurs when the chain asymptotically forgets where it started. It is a loss of memory property. Stability relates to the question of whether or not, despite temporary variations, there is a rough shape describing the long time behavior of the chain. For instance, we will discuss an example where the long time behavior is roughly described by a binomial, with temporal variations.

Related

• Quantitative merging for time-inhomogeneous Markov chains in non-decreasing environments via functional inequalities
• Markov chains revisited
• Exponential stability of nonhomogeneous matrix-valued Markovian chains
• Bounds on Mixing Time for Time-Inhomogeneous Markov Chains
• A Unified Stability Theory for Classical and Monotone Markov Chains