Priors in bayesian deep learning: A review

V Fortuin - International Statistical Review, 2022 - Wiley Online Library
While the choice of prior is one of the most critical parts of the Bayesian inference workflow,
recent Bayesian deep learning models have often fallen back on vague priors, such as …

What are Bayesian neural network posteriors really like?

P Izmailov, S Vikram, MD Hoffman… - … on machine learning, 2021 - proceedings.mlr.press
The posterior over Bayesian neural network (BNN) parameters is extremely high-
dimensional and non-convex. For computational reasons, researchers approximate this …

A primer on Bayesian neural networks: review and debates

J Arbel, K Pitas, M Vladimirova, V Fortuin - arxiv preprint arxiv:2309.16314, 2023 - arxiv.org
Neural networks have achieved remarkable performance across various problem domains,
but their widespread applicability is hindered by inherent limitations such as overconfidence …

Prior knowledge elicitation: The past, present, and future

P Mikkola, OA Martin, S Chandramouli… - Bayesian …, 2024 - projecteuclid.org
Prior Knowledge Elicitation: The Past, Present, and Future Page 1 Bayesian Analysis (2024)
19, Number 4, pp. 1129–1161 Prior Knowledge Elicitation: The Past, Present, and Future ∗ …

Position: Bayesian deep learning is needed in the age of large-scale AI

T Papamarkou, M Skoularidou, K Palla… - arxiv preprint arxiv …, 2024 - arxiv.org
In the current landscape of deep learning research, there is a predominant emphasis on
achieving high predictive accuracy in supervised tasks involving large image and language …

Learning functional priors and posteriors from data and physics

X Meng, L Yang, Z Mao, J del Águila Ferrandis… - Journal of …, 2022 - Elsevier
We develop a new Bayesian framework based on deep neural networks to be able to
extrapolate in space-time using historical data and to quantify uncertainties arising from both …

Bayesian neural networks with domain knowledge priors

D Sam, R Pukdee, DP Jeong, Y Byun… - arxiv preprint arxiv …, 2024 - arxiv.org
Bayesian neural networks (BNNs) have recently gained popularity due to their ability to
quantify model uncertainty. However, specifying a prior for BNNs that captures relevant …

Pre-trained Gaussian processes for Bayesian optimization

Z Wang, GE Dahl, K Swersky, C Lee, Z Nado… - Journal of Machine …, 2024 - jmlr.org
Bayesian optimization (BO) has become a popular strategy for global optimization of
expensive real-world functions. Contrary to a common expectation that BO is suited to …

Deep learning uncertainty quantification for ultrasonic damage identification in composite structures

H Lu, S Cantero-Chinchilla, X Yang, K Gryllias… - Composite …, 2024 - Elsevier
In this paper, three state-of-the-art deep learning uncertainty quantification (UQ) methods–
Flipout probabilistic convolutional neural network (CNN), deep ensemble probabilistic CNN …

A dimension-reduced variational approach for solving physics-based inverse problems using generative adversarial network priors and normalizing flows

A Dasgupta, DV Patel, D Ray, EA Johnson… - Computer Methods in …, 2024 - Elsevier
We propose a novel modular inference approach combining two different generative models—
generative adversarial networks (GAN) and normalizing flows—to approximate the posterior …