A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning

E Brochu, VM Cora, N De Freitas - arxiv preprint arxiv:1012.2599, 2010 - arxiv.org
We present a tutorial on Bayesian optimization, a method of finding the maximum of
expensive cost functions. Bayesian optimization employs the Bayesian technique of setting …

Riemann manifold langevin and hamiltonian monte carlo methods

M Girolami, B Calderhead - … the Royal Statistical Society Series B …, 2011 - academic.oup.com
The paper proposes Metropolis adjusted Langevin and Hamiltonian Monte Carlo sampling
methods defined on the Riemann manifold to resolve the shortcomings of existing Monte …

Nonparametric machine learning and efficient computation with Bayesian additive regression trees: The BART R package

R Sparapani, C Spanbauer, R McCulloch - Journal of Statistical …, 2021 - jstatsoft.org
In this article, we introduce the BART R package which is an acronym for Bayesian additive
regression trees. BART is a Bayesian nonparametric, machine learning, ensemble …

A model of text for experimentation in the social sciences

ME Roberts, BM Stewart, EM Airoldi - Journal of the American …, 2016 - Taylor & Francis
Statistical models of text have become increasingly popular in statistics and computer
science as a method of exploring large document collections. Social scientists often want to …

Nonasymptotic convergence analysis for the unadjusted Langevin algorithm

A Durmus, E Moulines - 2017 - projecteuclid.org
In this paper, we study a method to sample from a target distribution π over R^d having a
positive density with respect to the Lebesgue measure, known up to a normalisation factor …

Theoretical guarantees for approximate sampling from smooth and log-concave densities

AS Dalalyan - Journal of the Royal Statistical Society Series B …, 2017 - academic.oup.com
Sampling from various kinds of distribution is an issue of paramount importance in statistics
since it is often the key ingredient for constructing estimators, test procedures or confidence …

Bayesian inference for logistic models using Pólya–Gamma latent variables

NG Polson, JG Scott, J Windle - Journal of the American statistical …, 2013 - Taylor & Francis
We propose a new data-augmentation strategy for fully Bayesian inference in models with
binomial likelihoods. The approach appeals to a new class of Pólya–Gamma distributions …

High-dimensional Bayesian inference via the unadjusted Langevin algorithm

A Durmus, E Moulines - 2019 - projecteuclid.org
High-dimensional Bayesian inference via the unadjusted Langevin algorithm Page 1
Bernoulli 25(4A), 2019, 2854–2882 https://doi.org/10.3150/18-BEJ1073 High-dimensional …

Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations

H Rue, S Martino, N Chopin - Journal of the Royal Statistical …, 2009 - academic.oup.com
Structured additive regression models are perhaps the most commonly used class of models
in statistical applications. It includes, among others,(generalized) linear …

Analysis of Langevin Monte Carlo via convex optimization

A Durmus, S Majewski, B Miasojedow - Journal of Machine Learning …, 2019 - jmlr.org
In this paper, we provide new insights on the Unadjusted Langevin Algorithm. We show that
this method can be formulated as the first order optimization algorithm for an objective …