vix.ing · top · new · best · stats · spec

Asymptotically exact variational flows via involutive MCMC kernels

2025/06/02 by Zuheng Xu, Trevor Campbell, Xu, Zuheng +1 · 2 citations
Computer Science · Mathematics · #Advanced Mathematical Modeling in Engineering #Computation (stat.CO) #FOS: Computer and information sciences #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Mathematical Biology Tumor Growth

paper · pdf · doi:10.48550/arxiv.2506.02162

openalex publication_date 2025/06/02 · openalex created_date 2025/10/14 · openalex updated_date 2026/07/28

Abstract

Most expressive variational families -- such as normalizing flows -- lack practical convergence guarantees, as their theoretical assurances typically hold only at the intractable global optimum. In this work, we present a general recipe for constructing tuning-free, asymptotically exact variational flows on arbitrary state spaces from involutive MCMC kernels. The core methodological component is a novel representation of general involutive MCMC kernels as invertible, measurepreserving iterated random function systems, which act as the flow maps of our variational flows. This leads to three new variational families with provable total variation convergence. Our framework resolves key practical limitations of existing variational families with similar guarantees (e.g., MixFlows), while requiring substantially weaker theoretical assumptions. Finally, we demonstrate the competitive performance of our flows across tasks including posterior approximation, Monte Carlo estimates, and normalization constant estimation, outperforming or matching No-U-Turn sampler (NUTS) and black-box normalizing flows.

Citations

Cited by

Related