vix.ing · top · new · best · stats · spec

Second Order Ensemble Langevin Method for Sampling and Inverse Problems

2022/08/09 by Ziming Liu, Andrew M. Stuart, Liu, Ziming +3 · 2 citations
Computer Science · Mathematics · #Bayesian Methods and Mixture Models #Dynamical Systems (math.DS) #FOS: Computer and information sciences #FOS: Mathematics #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Markov Chains and Monte Carlo Methods #Methodology (stat.ME) #Numerical Analysis (math.NA)

paper · doi:10.48550/arxiv.2208.04506

openalex publication_date 2022/08/09 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We propose a sampling method based on an ensemble approximation of second order Langevin dynamics. The log target density is appended with a quadratic term in an auxiliary momentum variable and damped-driven Hamiltonian dynamics introduced; the resulting stochastic differential equation is invariant to the Gibbs measure, with marginal on the position coordinates given by the target. A preconditioner based on covariance under the law of the dynamics does not change this invariance property, and is introduced to accelerate convergence to the Gibbs measure. The resulting mean-field dynamics may be approximated by an ensemble method; this results in a gradient-free and affine-invariant stochastic dynamical system. Numerical results demonstrate its potential as the basis for a numerical sampler in Bayesian inverse problems.

Cited by

Related