Provable convergence guarantees for black-box variational inference

J Domke, R Gower, G Garrigos - Advances in neural …, 2024 - proceedings.neurips.cc
Black-box variational inference is widely used in situations where there is no proof that its
stochastic optimization succeeds. We suggest this is due to a theoretical gap in existing …

A framework for improving the reliability of black-box variational inference

M Welandawe, MR Andersen, A Vehtari… - Journal of Machine …, 2024 - jmlr.org
Black-box variational inference (BBVI) now sees widespread use in machine learning and
statistics as a fast yet flexible alternative to Markov chain Monte Carlo methods for …

Practical and matching gradient variance bounds for black-box variational Bayesian inference

K Kim, K Wu, J Oh, JR Gardner - … Conference on Machine …, 2023 - proceedings.mlr.press
Understanding the gradient variance of black-box variational inference (BBVI) is a crucial
step for establishing its convergence and develo** algorithmic improvements. However …

Imperative learning: A self-supervised neural-symbolic learning framework for robot autonomy

C Wang, K Ji, J Geng, Z Ren, T Fu, F Yang… - arxiv preprint arxiv …, 2024 - arxiv.org
Data-driven methods such as reinforcement and imitation learning have achieved
remarkable success in robot autonomy. However, their data-centric nature still hinders them …

Linear Convergence of Black-Box Variational Inference: Should We Stick the Landing?

K Kim, Y Ma, J Gardner - International Conference on …, 2024 - proceedings.mlr.press
We prove that black-box variational inference (BBVI) with control variates, particularly the
sticking-the-landing (STL) estimator, converges at a geometric (traditionally called “linear”) …

Model-based reinforcement learning with scalable composite policy gradient estimators

P Parmas, T Seno, Y Aoki - International Conference on …, 2023 - proceedings.mlr.press
In model-based reinforcement learning (MBRL), policy gradients can be estimated either by
derivative-free RL methods, such as likelihood ratio gradients (LR), or by backpropagating …

Robust, automated, and accurate black-box variational inference

M Welandawe, M Riis Anderson, A Vehtari, J Huggins - Ar**v, 2022 - open.bu.edu
Black-box variational inference (BBVI) now sees widespread use in machine learning and
statistics as a fast yet flexible alternative to Markov chain Monte Carlo methods for …

Sample average approximation for Black-Box VI

J Burroni, J Domke, D Sheldon - arxiv preprint arxiv:2304.06803, 2023 - arxiv.org
We present a novel approach for black-box VI that bypasses the difficulties of stochastic
gradient ascent, including the task of selecting step-sizes. Our approach involves using a …

Double control variates for gradient estimation in discrete latent variable models

M Titsias, J Shi - International Conference on Artificial …, 2022 - proceedings.mlr.press
Stochastic gradient-based optimisation for discrete latent variable models is challenging due
to the high variance of gradients. We introduce a variance reduction technique for score …

Divide and couple: Using monte carlo variational objectives for posterior approximation

J Domke, DR Sheldon - Advances in neural information …, 2019 - proceedings.neurips.cc
Recent work in variational inference (VI) has used ideas from Monte Carlo estimation to
obtain tighter lower bounds on the log-likelihood to be used as objectives for VI. However …