2022/04/22 by Khashayar Gatmiry, Santosh Vempala, Gatmiry, Khashayar +1 · 2 citations
Physics and Astronomy · #stochastic dynamics and bifurcation #Statistical Mechanics and Entropy #Advanced Thermodynamics and Statistical Mechanics
paper · pdf · doi:10.48550/arxiv.2204.10818
We study the Riemannian Langevin Algorithm for the problem of sampling from a distribution with density ν with respect to the natural measure on a manifold with metric g. We assume that the target density satisfies a log-Sobolev inequality with respect to the metric and prove that the manifold generalization of the Unadjusted Langevin Algorithm converges rapidly to ν for Hessian manifolds. This allows us to reduce the problem of sampling non-smooth (constrained) densities in \bf Rn to sampling smooth densities over appropriate manifolds, while needing access only to the gradient of the log-density, and this, in turn, to sampling from the natural Brownian motion on the manifold. Our main analytic tools are (1) an extension of self-concordance to manifolds, and (2) a stochastic approach to bounding smoothness on manifolds. A special case of our approach is sampling isoperimetric densities restricted to polytopes by using the metric defined by the logarithmic barrier.