Recent advances in Bayesian optimization

X Wang, Y **, S Schmitt, M Olhofer - ACM Computing Surveys, 2023 - dl.acm.org
Bayesian optimization has emerged at the forefront of expensive black-box optimization due
to its data efficiency. Recent years have witnessed a proliferation of studies on the …

Bayesian optimization for adaptive experimental design: A review

S Greenhill, S Rana, S Gupta, P Vellanki… - IEEE …, 2020 - ieeexplore.ieee.org
Bayesian optimisation is a statistical method that efficiently models and optimises expensive
“black-box” functions. This review considers the application of Bayesian optimisation to …

Bayesian optimization is superior to random search for machine learning hyperparameter tuning: Analysis of the black-box optimization challenge 2020

R Turner, D Eriksson, M McCourt… - NeurIPS 2020 …, 2021 - proceedings.mlr.press
This paper presents the results and insights from the black-box optimization (BBO)
challenge at NeurIPS2020 which ran from July–October, 2020. The challenge emphasized …

BoTorch: A framework for efficient Monte-Carlo Bayesian optimization

M Balandat, B Karrer, D Jiang… - Advances in neural …, 2020 - proceedings.neurips.cc
Bayesian optimization provides sample-efficient global optimization for a broad range of
applications, including automatic machine learning, engineering, physics, and experimental …

Self-play reinforcement learning guides protein engineering

Y Wang, H Tang, L Huang, L Pan, L Yang… - Nature Machine …, 2023 - nature.com
Designing protein sequences towards desired properties is a fundamental goal of protein
engineering, with applications in drug discovery and enzymatic engineering. Machine …

Batchbald: Efficient and diverse batch acquisition for deep bayesian active learning

A Kirsch, J Van Amersfoort… - Advances in neural …, 2019 - proceedings.neurips.cc
We develop BatchBALD, a tractable approximation to the mutual information between a
batch of points and model parameters, which we use as an acquisition function to select …

Scalable global optimization via local Bayesian optimization

D Eriksson, M Pearce, J Gardner… - Advances in neural …, 2019 - proceedings.neurips.cc
Bayesian optimization has recently emerged as a popular method for the sample-efficient
optimization of expensive black-box functions. However, the application to high-dimensional …

Population based augmentation: Efficient learning of augmentation policy schedules

D Ho, E Liang, X Chen, I Stoica… - … conference on machine …, 2019 - proceedings.mlr.press
A key challenge in leveraging data augmentation for neural network training is choosing an
effective augmentation policy from a large search space of candidate operations. Properly …

Machine learning with knowledge constraints for process optimization of open-air perovskite solar cell manufacturing

Z Liu, N Rolston, AC Flick, TW Colburn, Z Ren… - Joule, 2022 - cell.com
Develo** a scalable manufacturing technique for perovskite solar cells requires process
optimization in high-dimensional parameter space. Herein, we present a machine learning …

Population based training of neural networks

M Jaderberg, V Dalibard, S Osindero… - arxiv preprint arxiv …, 2017 - arxiv.org
Neural networks dominate the modern machine learning landscape, but their training and
success still suffer from sensitivity to empirical choices of hyperparameters such as model …