2025/10/08 by Adrien Corenflos, Hai-Dang Dau, Corenflos, Adrien +1 · 2 voices · 1 citation
Computer Science · Mathematics · Physics and Astronomy · #Convergence (economics) #Hellinger distance #Hybrid Monte Carlo #Markov Chains and Monte Carlo Methods #Markov chain #Markov chain Monte Carlo #Markov chain mixing time #Monte Carlo method #Statistical Mechanics and Entropy #Target Tracking and Data Fusion in Sensor Networks #Weighting
paper · pdf · doi:10.48550/arxiv.2510.07559
published in arXiv (Cornell University) (Cornell University)
openalex publication_date 2025/10/08 · openalex created_date 2025/10/11 · openalex updated_date 2026/08/05
A long-standing gap exists between the theoretical analysis of Markov chain Monte Carlo convergence, which is often based on statistical divergences, and the diagnostics used in practice. We introduce the first general convergence diagnostics for Markov chain Monte Carlo based on any f-divergence, allowing users to directly monitor, among others, the Kullback-Leibler and the χ2 divergences as well as the Hellinger and the total variation distances. Our approach rests on a coupling-based "weight harmonization" scheme that produces direct, computable, and consistent importance weights for interacting Markov chains with respect to their target distribution. Beyond their use as convergence diagnostics, these weights are consistent estimates of the Radon-Nikodym derivative dπ/d μt, a richer object than the convergence bounds alone, with natural applications to importance-weighted inference. We show how such weightings can provide upper bounds to any f-divergence, prove that these bounds tighten over time and converge to zero as the chains approach stationarity, and demonstrate that, while more conservative than existing coupling-based total variation estimators, our method remains a practical and broadly applicable diagnostic tool.