Markov chain Monte Carlo in practice

GL Jones, Q Qin - Annual Review of Statistics and Its Application, 2022 - annualreviews.org
Markov chain Monte Carlo (MCMC) is an essential set of tools for estimating features of
probability distributions commonly encountered in modern applications. For MCMC …

Geometric integrators and the Hamiltonian Monte Carlo method

N Bou-Rabee, JM Sanz-Serna - Acta Numerica, 2018 - cambridge.org
This paper surveys in detail the relations between numerical integration and the Hamiltonian
(or hybrid) Monte Carlo method (HMC). Since the computational cost of HMC mainly lies in …

Score-based generative models detect manifolds

J Pidstrigach - Advances in Neural Information Processing …, 2022 - proceedings.neurips.cc
Score-based generative models (SGMs) need to approximate the scores $\nabla\log p_t $ of
the intermediate distributions as well as the final distribution $ p_T $ of the forward process …

Rapid convergence of the unadjusted langevin algorithm: Isoperimetry suffices

S Vempala, A Wibisono - Advances in neural information …, 2019 - proceedings.neurips.cc
Abstract We study the Unadjusted Langevin Algorithm (ULA) for sampling from a probability
distribution $\nu= e^{-f} $ on $\R^ n $. We prove a convergence guarantee in Kullback …

Underdamped Langevin MCMC: A non-asymptotic analysis

X Cheng, NS Chatterji, PL Bartlett… - … on learning theory, 2018 - proceedings.mlr.press
We study the underdamped Langevin diffusion when the log of the target distribution is
smooth and strongly concave. We present a MCMC algorithm based on its discretization and …

Log-concave sampling: Metropolis-Hastings algorithms are fast

R Dwivedi, Y Chen, MJ Wainwright, B Yu - Journal of Machine Learning …, 2019 - jmlr.org
We study the problem of sampling from a strongly log-concave density supported on
$\mathbb {R}^ d $, and prove a non-asymptotic upper bound on the mixing time of the …

Sampling can be faster than optimization

YA Ma, Y Chen, C **, N Flammarion… - Proceedings of the …, 2019 - pnas.org
Optimization algorithms and Monte Carlo sampling algorithms have provided the
computational foundations for the rapid growth in applications of statistical machine learning …

Generalized energy based models

M Arbel, L Zhou, A Gretton - arxiv preprint arxiv:2003.05033, 2020 - arxiv.org
We introduce the Generalized Energy Based Model (GEBM) for generative modelling. These
models combine two trained components: a base distribution (generally an implicit model) …

On sampling from a log-concave density using kinetic Langevin diffusions

AS Dalalyan, L Riou-Durand - 2020 - projecteuclid.org
Langevin diffusion processes and their discretizations are often used for sampling from a
target density. The most convenient framework for assessing the quality of such a sampling …

Sharp convergence rates for Langevin dynamics in the nonconvex setting

X Cheng, NS Chatterji, Y Abbasi-Yadkori… - arxiv preprint arxiv …, 2018 - arxiv.org
We study the problem of sampling from a distribution $ p^*(x)\propto\exp\left (-U (x)\right) $,
where the function $ U $ is $ L $-smooth everywhere and $ m $-strongly convex outside a …