A survey of Monte Carlo methods for parameter estimation

D Luengo, L Martino, M Bugallo, V Elvira… - EURASIP Journal on …, 2020 - Springer
Statistical signal processing applications usually require the estimation of some parameters
of interest given a set of observed data. These estimates are typically obtained either by …

Riemann manifold langevin and hamiltonian monte carlo methods

M Girolami, B Calderhead - … the Royal Statistical Society Series B …, 2011 - academic.oup.com
The paper proposes Metropolis adjusted Langevin and Hamiltonian Monte Carlo sampling
methods defined on the Riemann manifold to resolve the shortcomings of existing Monte …

An optimization-centric view on Bayes' rule: Reviewing and generalizing variational inference

J Knoblauch, J Jewson, T Damoulas - Journal of Machine Learning …, 2022 - jmlr.org
We advocate an optimization-centric view of Bayesian inference. Our inspiration is the
representation of Bayes' rule as infinite-dimensional optimization (Csisz´ r, 1975; Donsker …

[PDF][PDF] The No-U-Turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo.

MD Hoffman, A Gelman - J. Mach. Learn. Res., 2014 - jmlr.org
Abstract Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) algorithm
that avoids the random walk behavior and sensitivity to correlated parameters that plague …

Hamiltonian Monte Carlo for hierarchical models

M Betancourt, M Girolami - Current trends in Bayesian …, 2015 - api.taylorfrancis.com
Many of the most exciting problems in applied statistics involve intricate, typically high-
dimensional, models and, at least relative to the model complexity, sparse data. With the …

MCMC methods for functions: modifying old algorithms to make them faster

SL Cotter, GO Roberts, AM Stuart, D White - 2013 - projecteuclid.org
Many problems arising in applications result in the need to probe a probability distribution
for functions. Examples include Bayesian nonparametric statistics and conditioned diffusion …

The geometric foundations of hamiltonian monte carlo

M Betancourt, S Byrne, S Livingstone, M Girolami - 2017 - projecteuclid.org
Abstract Although Hamiltonian Monte Carlo has proven an empirical success, the lack of a
rigorous theoretical understanding of the algorithm has in many ways impeded both …

Bayesian computation: a summary of the current state, and samples backwards and forwards

PJ Green, K Łatuszyński, M Pereyra, CP Robert - Statistics and Computing, 2015 - Springer
Recent decades have seen enormous improvements in computational inference for
statistical models; there have been competitive continual enhancements in a wide range of …

A survey of stochastic simulation and optimization methods in signal processing

M Pereyra, P Schniter, E Chouzenoux… - IEEE Journal of …, 2015 - ieeexplore.ieee.org
Modern signal processing (SP) methods rely very heavily on probability and statistics to
solve challenging SP problems. SP methods are now expected to deal with ever more …

On the geometric ergodicity of Hamiltonian Monte Carlo

S Livingstone, M Betancourt, S Byrne, M Girolami - 2019 - projecteuclid.org
Supplement to “On the geometric ergodicity of Hamiltonian Monte Carlo”. We provide
additional examples of π-irreducibility, with supporting plots, as well as elaborating on the …