Priors in bayesian deep learning: A review

V Fortuin - International Statistical Review, 2022 - Wiley Online Library
While the choice of prior is one of the most critical parts of the Bayesian inference workflow,
recent Bayesian deep learning models have often fallen back on vague priors, such as …

Laplace redux-effortless bayesian deep learning

E Daxberger, A Kristiadi, A Immer… - Advances in …, 2021 - proceedings.neurips.cc
Bayesian formulations of deep learning have been shown to have compelling theoretical
properties and offer practical functional benefits, such as improved predictive uncertainty …

Repulsive deep ensembles are bayesian

F D'Angelo, V Fortuin - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Deep ensembles have recently gained popularity in the deep learning community for their
conceptual simplicity and efficiency. However, maintaining functional diversity between …

Position paper: Bayesian deep learning in the age of large-scale ai

T Papamarkou, M Skoularidou, K Palla… - arxiv e …, 2024 - ui.adsabs.harvard.edu
In the current landscape of deep learning research, there is a predominant emphasis on
achieving high predictive accuracy in supervised tasks involving large image and language …

Scalable Bayesian uncertainty quantification for neural network potentials: promise and pitfalls

S Thaler, G Doehner, J Zavadlav - Journal of Chemical Theory …, 2023 - ACS Publications
Neural network (NN) potentials promise highly accurate molecular dynamics (MD)
simulations within the computational complexity of classical MD force fields. However, when …

Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI

T Papamarkou, M Skoularidou, K Palla… - … on Machine Learning, 2024 - openreview.net
In the current landscape of deep learning research, there is a predominant emphasis on
achieving high predictive accuracy in supervised tasks involving large image and language …

Data augmentation in Bayesian neural networks and the cold posterior effect

S Nabarro, S Ganev, A Garriga-Alonso… - Uncertainty in …, 2022 - proceedings.mlr.press
Bayesian neural networks that incorporate data augmentation implicitly use a “randomly
perturbed log-likelihood [which] does not have a clean interpretation as a valid likelihood …

On stein variational neural network ensembles

F D'Angelo, V Fortuin, F Wenzel - arxiv preprint arxiv:2106.10760, 2021 - arxiv.org
Ensembles of deep neural networks have achieved great success recently, but they do not
offer a proper Bayesian justification. Moreover, while they allow for averaging of predictions …

[HTML][HTML] BNNpriors: A library for Bayesian neural network inference with different prior distributions

V Fortuin, A Garriga-Alonso, M van der Wilk… - Software Impacts, 2021 - Elsevier
Bayesian neural networks have shown great promise in many applications where calibrated
uncertainty estimates are crucial and can often also lead to a higher predictive performance …

Promises and pitfalls of the linearized Laplace in Bayesian optimization

A Kristiadi, A Immer, R Eschenhagen… - arxiv preprint arxiv …, 2023 - arxiv.org
The linearized-Laplace approximation (LLA) has been shown to be effective and efficient in
constructing Bayesian neural networks. It is theoretically compelling since it can be seen as …