Variational inference: A review for statisticians

DM Blei, A Kucukelbir, JD McAuliffe - Journal of the American …, 2017 - Taylor & Francis
One of the core problems of modern statistics is to approximate difficult-to-compute
probability densities. This problem is especially important in Bayesian statistics, which …

Twenty years of mixture of experts

SE Yuksel, JN Wilson, PD Gader - IEEE transactions on neural …, 2012 - ieeexplore.ieee.org
In this paper, we provide a comprehensive survey of the mixture of experts (ME). We discuss
the fundamental models for regression and classification and also their training with the …

Simultaneous localization, map** and moving object tracking

CC Wang, C Thorpe, S Thrun… - … Journal of Robotics …, 2007 - journals.sagepub.com
Simultaneous localization, map** and moving object tracking (SLAMMOT) involves both
simultaneous localization and map** (SLAM) in dynamic environments and detecting and …

The case for objective Bayesian analysis

J Berger - 2006 - projecteuclid.org
Bayesian statistical practice makes extensive use of versions of objective Bayesian analysis.
We discuss why this is so, and address some of the criticisms that have been raised …

Competitive coevolution through evolutionary complexification

KO Stanley, R Miikkulainen - Journal of artificial intelligence research, 2004 - jair.org
Two major goals in machine learning are the discovery and improvement of solutions to
complex problems. In this paper, we argue that complexification, ie the incremental …

α-variational inference with statistical guarantees

Y Yang, D Pati, A Bhattacharya - The Annals of Statistics, 2020 - JSTOR
We provide statistical guarantees for a family of variational approximations to Bayesian
posterior distributions, called α-VB, which has close connections with variational …

A survey of neural trees

H Li, J Song, M Xue, H Zhang, J Ye, L Cheng… - arxiv preprint arxiv …, 2022 - arxiv.org
Neural networks (NNs) and decision trees (DTs) are both popular models of machine
learning, yet coming with mutually exclusive advantages and limitations. To bring the best of …

Multi-fidelity Gaussian process regression for computer experiments

L Le Gratiet - 2013 - theses.hal.science
Résumé This work is on Gaussian-process based approximation of a code which can be run
at different levels of accuracy. The goal is to improve the predictions of a surrogate model of …

Bayesian methods for neural networks and related models

DM Titterington - Statistical science, 2004 - JSTOR
Models such as feed-forward neural networks and certain other structures investigated in the
computer science literature are not amenable to closed-form Bayesian analysis. The paper …

Bayesian estimation of beta mixture models with variational inference

Z Ma, A Leijon - IEEE Transactions on Pattern Analysis and …, 2011 - ieeexplore.ieee.org
Bayesian estimation of the parameters in beta mixture models (BMM) is analytically
intractable. The numerical solutions to simulate the posterior distribution are available, but …