A survey of feedback particle filter and related controlled interacting particle systems (CIPS)

A Taghvaei, PG Mehta - Annual Reviews in Control, 2023 - Elsevier
In this survey, we describe controlled interacting particle systems (CIPS) to approximate the
solution of the optimal filtering and the optimal control problems. Part I of the survey is …

On the geometry of Stein variational gradient descent

A Duncan, N Nüsken, L Szpruch - Journal of Machine Learning Research, 2023 - jmlr.org
Bayesian inference problems require sampling or approximating high-dimensional
probability distributions. The focus of this paper is on the recently introduced Stein …

Function space particle optimization for Bayesian neural networks

Z Wang, T Ren, J Zhu, B Zhang - arxiv preprint arxiv:1902.09754, 2019 - arxiv.org
While Bayesian neural networks (BNNs) have drawn increasing attention, their posterior
inference remains challenging, due to the high-dimensional and over-parameterized nature …

Accelerated information gradient flow

Y Wang, W Li - Journal of Scientific Computing, 2022 - Springer
We present a framework for Nesterov's accelerated gradient flows in probability space to
design efficient mean-field Markov chain Monte Carlo algorithms for Bayesian inverse …

Information Newton's flow: second-order optimization method in probability space

Y Wang, W Li - arxiv preprint arxiv:2001.04341, 2020 - arxiv.org
We introduce a framework for Newton's flows in probability space with information metrics,
named information Newton's flows. Here two information metrics are considered, including …

Accelerated flow for probability distributions

A Taghvaei, P Mehta - International conference on machine …, 2019 - proceedings.mlr.press
This paper presents a methodology and numerical algorithms for constructing accelerated
gradient flows on the space of probability distributions. In particular, we extend the recent …

Variational optimization on lie groups, with examples of leading (generalized) eigenvalue problems

M Tao, T Ohsawa - International Conference on Artificial …, 2020 - proceedings.mlr.press
The article considers smooth optimization of functions on Lie groups. By generalizing NAG
variational principle in vector space (Wibisono et al., 2016) to general Lie groups …

Understanding MCMC dynamics as flows on the Wasserstein space

C Liu, J Zhuo, J Zhu - International Conference on Machine …, 2019 - proceedings.mlr.press
It is known that the Langevin dynamics used in MCMC is the gradient flow of the KL
divergence on the Wasserstein space, which helps convergence analysis and inspires …

Straight-through estimator as projected Wasserstein gradient flow

P Cheng, C Liu, C Li, D Shen, R Henao… - arxiv preprint arxiv …, 2019 - arxiv.org
The Straight-Through (ST) estimator is a widely used technique for back-propagating
gradients through discrete random variables. However, this effective method lacks …

An Interacting Wasserstein Gradient Flow Strategy to Robust Bayesian Inference

F Igea, A Cicirello - arxiv preprint arxiv:2401.11607, 2024 - arxiv.org
Model Updating is frequently used in Structural Health Monitoring to determine structures'
operating conditions and whether maintenance is required. Data collected by sensors are …