[HTML][HTML] A review of uncertainty quantification in deep learning: Techniques, applications and challenges

M Abdar, F Pourpanah, S Hussain, D Rezazadegan… - Information fusion, 2021 - Elsevier
Uncertainty quantification (UQ) methods play a pivotal role in reducing the impact of
uncertainties during both optimization and decision making processes. They have been …

Semantic uncertainty: Linguistic invariances for uncertainty estimation in natural language generation

L Kuhn, Y Gal, S Farquhar - arxiv preprint arxiv:2302.09664, 2023 - arxiv.org
We introduce a method to measure uncertainty in large language models. For tasks like
question answering, it is essential to know when we can trust the natural language outputs …

Bayesian deep learning via subnetwork inference

E Daxberger, E Nalisnick… - International …, 2021 - proceedings.mlr.press
The Bayesian paradigm has the potential to solve core issues of deep neural networks such
as poor calibration and data inefficiency. Alas, scaling Bayesian inference to large weight …

On the expressiveness of approximate inference in bayesian neural networks

A Foong, D Burt, Y Li, R Turner - Advances in Neural …, 2020 - proceedings.neurips.cc
Abstract While Bayesian neural networks (BNNs) hold the promise of being flexible, well-
calibrated statistical models, inference often requires approximations whose consequences …

Uncertainty estimation and quantification for llms: A simple supervised approach

L Liu, Y Pan, X Li, G Chen - arxiv preprint arxiv:2404.15993, 2024 - arxiv.org
In this paper, we study the problem of uncertainty estimation and calibration for LLMs. We
begin by formulating the uncertainty estimation problem, a relevant yet underexplored area …

Radial bayesian neural networks: Beyond discrete support in large-scale bayesian deep learning

S Farquhar, MA Osborne, Y Gal - … Conference on Artificial …, 2020 - proceedings.mlr.press
Abstract We propose Radial Bayesian Neural Networks (BNNs): a variational approximate
posterior for BNNs which scales well to large models. Unlike scalable Bayesian deep …

Specifying weight priors in bayesian deep neural networks with empirical bayes

R Krishnan, M Subedar, O Tickoo - Proceedings of the AAAI conference on …, 2020 - aaai.org
Stochastic variational inference for Bayesian deep neural network (DNN) requires specifying
priors and approximate posterior distributions over neural network weights. Specifying …

Latent derivative Bayesian last layer networks

J Watson, JA Lin, P Klink… - International …, 2021 - proceedings.mlr.press
Bayesian neural networks (BNN) are powerful parametric models for nonlinear regression
with uncertainty quantification. However, the approximate inference techniques for weight …

A prospective evaluation of AI-augmented epidemiology to forecast COVID-19 in the USA and Japan

SÖ Arık, J Shor, R Sinha, J Yoon, JR Ledsam… - NPJ digital …, 2021 - nature.com
The COVID-19 pandemic has highlighted the global need for reliable models of disease
spread. We propose an AI-augmented forecast modeling framework that provides daily …

Wat zei je? detecting out-of-distribution translations with variational transformers

TZ **ao, AN Gomez, Y Gal - arxiv preprint arxiv:2006.08344, 2020 - arxiv.org
We detect out-of-training-distribution sentences in Neural Machine Translation using the
Bayesian Deep Learning equivalent of Transformer models. For this we develop a new …