[HTML][HTML] A review of uncertainty quantification in deep learning: Techniques, applications and challenges

M Abdar, F Pourpanah, S Hussain, D Rezazadegan… - Information fusion, 2021 - Elsevier
Uncertainty quantification (UQ) methods play a pivotal role in reducing the impact of
uncertainties during both optimization and decision making processes. They have been …

A survey of uncertainty in deep neural networks

J Gawlikowski, CRN Tassi, M Ali, J Lee, M Humt… - Artificial Intelligence …, 2023 - Springer
Over the last decade, neural networks have reached almost every field of science and
become a crucial part of various real world applications. Due to the increasing spread …

What are Bayesian neural network posteriors really like?

P Izmailov, S Vikram, MD Hoffman… - … on machine learning, 2021 - proceedings.mlr.press
The posterior over Bayesian neural network (BNN) parameters is extremely high-
dimensional and non-convex. For computational reasons, researchers approximate this …

Dangers of Bayesian model averaging under covariate shift

P Izmailov, P Nicholson, S Lotfi… - Advances in Neural …, 2021 - proceedings.neurips.cc
Approximate Bayesian inference for neural networks is considered a robust alternative to
standard training, often providing good performance on out-of-distribution data. However …

FPGA-based acceleration for Bayesian convolutional neural networks

H Fan, M Ferianc, Z Que, S Liu, X Niu… - … on Computer-Aided …, 2022 - ieeexplore.ieee.org
Neural networks (NNs) have demonstrated their potential in a variety of domains ranging
from computer vision (CV) to natural language processing. Among various NNs, two …

Uncertainty quantification in medical image synthesis

R Barbano, S Arridge, B **, R Tanno - Biomedical Image Synthesis and …, 2022 - Elsevier
Abstract Machine learning approaches to medical image synthesis have shown outstanding
performance, but often do not convey uncertainty information. In this chapter, we survey …

Sparse uncertainty representation in deep learning with inducing weights

H Ritter, M Kukla, C Zhang, Y Li - Advances in Neural …, 2021 - proceedings.neurips.cc
Abstract Bayesian Neural Networks and deep ensembles represent two modern paradigms
of uncertainty quantification in deep learning. Yet these approaches struggle to scale mainly …

BiSNN: training spiking neural networks with binary weights via bayesian learning

H Jang, N Skatchkovsky… - 2021 IEEE Data Science …, 2021 - ieeexplore.ieee.org
Artificial Neural Network (ANN)-based inference on battery-powered devices can be made
more energy-efficient by restricting the synaptic weights to be binary, hence eliminating the …

Structured dropout variational inference for Bayesian neural networks

S Nguyen, D Nguyen, K Nguyen… - Advances in Neural …, 2021 - proceedings.neurips.cc
Approximate inference in Bayesian deep networks exhibits a dilemma of how to yield high
fidelity posterior approximations while maintaining computational efficiency and scalability …

Informative Bayesian neural network priors for weak signals

T Cui, A Havulinna, P Marttinen, S Kaski - Bayesian Analysis, 2022 - projecteuclid.org
Encoding domain knowledge into the prior over the high-dimensional weight space of a
neural network is challenging but essential in applications with limited data and weak …