A primer on Bayesian neural networks: review and debates

J Arbel, K Pitas, M Vladimirova, V Fortuin - arxiv preprint arxiv:2309.16314, 2023 - arxiv.org
Neural networks have achieved remarkable performance across various problem domains,
but their widespread applicability is hindered by inherent limitations such as overconfidence …

Position: Bayesian deep learning is needed in the age of large-scale AI

T Papamarkou, M Skoularidou, K Palla… - arxiv preprint arxiv …, 2024 - arxiv.org
In the current landscape of deep learning research, there is a predominant emphasis on
achieving high predictive accuracy in supervised tasks involving large image and language …

Beyond deep ensembles: A large-scale evaluation of bayesian deep learning under distribution shift

F Seligmann, P Becker, M Volpp… - Advances in Neural …, 2023 - proceedings.neurips.cc
Bayesian deep learning (BDL) is a promising approach to achieve well-calibrated
predictions on distribution-shifted data. Nevertheless, there exists no large-scale survey that …

Bayesian neural networks with domain knowledge priors

D Sam, R Pukdee, DP Jeong, Y Byun… - arxiv preprint arxiv …, 2024 - arxiv.org
Bayesian neural networks (BNNs) have recently gained popularity due to their ability to
quantify model uncertainty. However, specifying a prior for BNNs that captures relevant …

Gaussian stochastic weight averaging for Bayesian low-rank adaptation of large language models

E Onal, K Flöge, E Caldwell, A Sheverdin… - arxiv preprint arxiv …, 2024 - arxiv.org
Fine-tuned Large Language Models (LLMs) often suffer from overconfidence and poor
calibration, particularly when fine-tuned on small datasets. To address these challenges, we …

Promises and pitfalls of the linearized Laplace in Bayesian optimization

A Kristiadi, A Immer, R Eschenhagen… - arxiv preprint arxiv …, 2023 - arxiv.org
The linearized-Laplace approximation (LLA) has been shown to be effective and efficient in
constructing Bayesian neural networks. It is theoretically compelling since it can be seen as …

[PDF][PDF] Laplace-approximated neural additive models: Improving interpretability with Bayesian inference

K Bouchiat, A Immer, H Yèche, G Rätsch, V Fortuin - stat, 2023 - researchgate.net
Deep neural networks (DNNs) have found successful applications in many fields, but their
black-box nature hinders interpretability. This is addressed by the neural additive model …

Optimization Proxies using Limited Labeled Data and Training Time--A Semi-Supervised Bayesian Neural Network Approach

P Pareek, K Sundar, D Deka, S Misra - arxiv preprint arxiv:2410.03085, 2024 - arxiv.org
Constrained optimization problems arise in various engineering system operations such as
inventory management and electric power grids. However, the requirement to repeatedly …

Towards Dynamic Feature Acquisition on Medical Time Series by Maximizing Conditional Mutual Information

F Sergeev, P Malsot, G Rätsch, V Fortuin - arxiv preprint arxiv:2407.13429, 2024 - arxiv.org
Knowing which features of a multivariate time series to measure and when is a key task in
medicine, wearables, and robotics. Better acquisition policies can reduce costs while …

Linearized Laplace Inference in Neural Additive Models

K Bouchiat, A Immer, H Yèche… - Fifth Symposium on …, 2023 - openreview.net
Deep neural networks are highly effective but suffer from a lack of interpretability due to their
black-box nature. Neural additive models (NAMs) solve this by separating into additive sub …