vix.ing · top · new · best · stats · spec

Accelerate Langevin Sampling with Birth-Death Process and Exploration Component

2023/05/06 by Lezhi Tan, Tan, Lezhi, Jianfeng Lu +1 · 2 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Mathematics · #60J80 #62F15 #65C05 #65C35 #Computation (stat.CO) #Diffusion and Search Dynamics #FOS: Computer and information sciences #FOS: Mathematics #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Probability (math.PR) #Statistics Theory (math.ST)

paper · pdf · doi:10.48550/arxiv.2305.05529

openalex publication_date 2023/05/06 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Sampling a probability distribution with known likelihood is a fundamental task in computational science and engineering. Aiming at multimodality, we propose a new sampling method that takes advantage of both birth-death process and exploration component. The main idea of this method is look before you leap. We keep two sets of samplers, one at warmer temperature and one at original temperature. The former one serves as pioneer in exploring new modes and passing useful information to the other, while the latter one samples the target distribution after receiving the information. We derive a mean-field limit and show how the exploration component accelerates the sampling process. Moreover, we prove exponential asymptotic convergence under mild assumption. Finally, we test on experiments from previous literature and compare our methodology to previous ones.

Cited by

Related