Stein's method meets computational statistics: A review of some recent developments

A Anastasiou, A Barp, FX Briol, B Ebner… - Statistical …, 2023 - projecteuclid.org
Stein's method compares probability distributions through the study of a class of linear
operators called Stein operators. While mainly studied in probability and used to underpin …

An optimization-centric view on Bayes' rule: Reviewing and generalizing variational inference

J Knoblauch, J Jewson, T Damoulas - Journal of Machine Learning …, 2022 - jmlr.org
We advocate an optimization-centric view of Bayesian inference. Our inspiration is the
representation of Bayes' rule as infinite-dimensional optimization (Csisz´ r, 1975; Donsker …

Score matching enables causal discovery of nonlinear additive noise models

P Rolland, V Cevher, M Kleindessner… - International …, 2022 - proceedings.mlr.press
This paper demonstrates how to recover causal graphs from the score of the data
distribution in non-linear additive (Gaussian) noise models. Using score matching …

Statistical efficiency of score matching: The view from isoperimetry

F Koehler, A Heckett, A Risteski - arxiv preprint arxiv:2210.00726, 2022 - arxiv.org
Deep generative models parametrized up to a normalizing constant (eg energy-based
models) are difficult to train by maximizing the likelihood of the data because the likelihood …

Robust generalised Bayesian inference for intractable likelihoods

T Matsubara, J Knoblauch, FX Briol… - Journal of the Royal …, 2022 - academic.oup.com
Generalised Bayesian inference updates prior beliefs using a loss function, rather than a
likelihood, and can therefore be used to confer robustness against possible mis …

Generalized variational inference: Three arguments for deriving new posteriors

J Knoblauch, J Jewson, T Damoulas - arxiv preprint arxiv:1904.02063, 2019 - arxiv.org
We advocate an optimization-centric view on and introduce a novel generalization of
Bayesian inference. Our inspiration is the representation of Bayes' rule as infinite …

Learning the stein discrepancy for training and evaluating energy-based models without sampling

W Grathwohl, KC Wang, JH Jacobsen… - International …, 2020 - proceedings.mlr.press
We present a new method for evaluating and training unnormalized density models. Our
approach only requires access to the gradient of the unnormalized model's log-density. We …

Robust and scalable Bayesian online changepoint detection

M Altamirano, FX Briol… - … Conference on Machine …, 2023 - proceedings.mlr.press
This paper proposes an online, provably robust, and scalable Bayesian approach for
changepoint detection. The resulting algorithm has key advantages over previous work: it …

Provable benefits of score matching

C Pabbaraju, D Rohatgi, AP Sevekari… - Advances in …, 2023 - proceedings.neurips.cc
Score matching is an alternative to maximum likelihood (ML) for estimating a probability
distribution parametrized up to a constant of proportionality. By fitting the''score''of the …

Robust and conjugate Gaussian process regression

M Altamirano, FX Briol, J Knoblauch - arxiv preprint arxiv:2311.00463, 2023 - arxiv.org
To enable closed form conditioning, a common assumption in Gaussian process (GP)
regression is independent and identically distributed Gaussian observation noise. This …