A primer on Bayesian neural networks: review and debates
Neural networks have achieved remarkable performance across various problem domains,
but their widespread applicability is hindered by inherent limitations such as overconfidence …
but their widespread applicability is hindered by inherent limitations such as overconfidence …
Position: Bayesian deep learning is needed in the age of large-scale AI
In the current landscape of deep learning research, there is a predominant emphasis on
achieving high predictive accuracy in supervised tasks involving large image and language …
achieving high predictive accuracy in supervised tasks involving large image and language …
Beyond deep ensembles: A large-scale evaluation of bayesian deep learning under distribution shift
Bayesian deep learning (BDL) is a promising approach to achieve well-calibrated
predictions on distribution-shifted data. Nevertheless, there exists no large-scale survey that …
predictions on distribution-shifted data. Nevertheless, there exists no large-scale survey that …
Bayesian neural networks with domain knowledge priors
Bayesian neural networks (BNNs) have recently gained popularity due to their ability to
quantify model uncertainty. However, specifying a prior for BNNs that captures relevant …
quantify model uncertainty. However, specifying a prior for BNNs that captures relevant …
Gaussian stochastic weight averaging for Bayesian low-rank adaptation of large language models
Fine-tuned Large Language Models (LLMs) often suffer from overconfidence and poor
calibration, particularly when fine-tuned on small datasets. To address these challenges, we …
calibration, particularly when fine-tuned on small datasets. To address these challenges, we …
Promises and pitfalls of the linearized Laplace in Bayesian optimization
The linearized-Laplace approximation (LLA) has been shown to be effective and efficient in
constructing Bayesian neural networks. It is theoretically compelling since it can be seen as …
constructing Bayesian neural networks. It is theoretically compelling since it can be seen as …
[PDF][PDF] Laplace-approximated neural additive models: Improving interpretability with Bayesian inference
Deep neural networks (DNNs) have found successful applications in many fields, but their
black-box nature hinders interpretability. This is addressed by the neural additive model …
black-box nature hinders interpretability. This is addressed by the neural additive model …
Optimization Proxies using Limited Labeled Data and Training Time--A Semi-Supervised Bayesian Neural Network Approach
Constrained optimization problems arise in various engineering system operations such as
inventory management and electric power grids. However, the requirement to repeatedly …
inventory management and electric power grids. However, the requirement to repeatedly …
Towards Dynamic Feature Acquisition on Medical Time Series by Maximizing Conditional Mutual Information
Knowing which features of a multivariate time series to measure and when is a key task in
medicine, wearables, and robotics. Better acquisition policies can reduce costs while …
medicine, wearables, and robotics. Better acquisition policies can reduce costs while …
Linearized Laplace Inference in Neural Additive Models
Deep neural networks are highly effective but suffer from a lack of interpretability due to their
black-box nature. Neural additive models (NAMs) solve this by separating into additive sub …
black-box nature. Neural additive models (NAMs) solve this by separating into additive sub …