vix.ing · top · new · best · stats

Coupling and Decoupling to bound an approximating Markov Chain

2017/06/07 by James E. Johndrow, JE Johndrow, Johndrow, James E. +3
Computer Science · Mathematics · #60J #Bayesian Methods and Mixture Models #FOS: Mathematics #Markov Chains and Monte Carlo Methods #Probability (math.PR) #Statistical Methods and Inference #math.PR #msc:60J

paper · pdf · doi:10.48550/arxiv.1706.02040

openalex publication_date 2017/06/07 · arxiv created 2017/11/14 · arxiv updated 2017/11/16 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This simple note lays out a few observations which are well known in many ways but may not have been said in quite this way before. The basic idea is that when comparing two different Markov chains it is useful to couple them is such a way that they agree as often as possible. We construct such a coupling and analyze it by a simple dominating chain which registers if the two processes agree or disagree. We find that this imagery is useful when thinking about such problems. We are particularly interested in comparing the invariant measures and long time averages of the processes. However, since the paths agree for long runs, it also provides estimates on various stopping times such as hitting or exit times. We also show that certain bounds are tight. Finally, we provide a simple application to a Markov Chain Monte Carlo algorithm and show numerically that the results of the paper show a good level of approximation at considerable speed up by using an approximating chain rather than the original sampling chain.

Related