Unexpected improvements to expected improvement for bayesian optimization

S Ament, S Daulton, D Eriksson… - Advances in …, 2023 - proceedings.neurips.cc
Expected Improvement (EI) is arguably the most popular acquisition function in Bayesian
optimization and has found countless successful applications, but its performance is often …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arxiv preprint arxiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

Joint entropy search for multi-objective bayesian optimization

B Tu, A Gandy, N Kantas… - Advances in Neural …, 2022 - proceedings.neurips.cc
Many real-world problems can be phrased as a multi-objective optimization problem, where
the goal is to identify the best set of compromises between the competing objectives. Multi …

[HTML][HTML] Combining multi-fidelity modelling and asynchronous batch Bayesian Optimization

JP Folch, RM Lee, B Shafei, D Walz, C Tsay… - Computers & Chemical …, 2023 - Elsevier
Bayesian Optimization is a useful tool for experiment design. Unfortunately, the classical,
sequential setting of Bayesian Optimization does not translate well into laboratory …

Randomized Gaussian process upper confidence bound with tighter Bayesian regret bounds

S Takeno, Y Inatsu… - … Conference on Machine …, 2023 - proceedings.mlr.press
Gaussian process upper confidence bound (GP-UCB) is a theoretically promising approach
for black-box optimization; however, the confidence parameter $\beta $ is considerably large …

Self-correcting bayesian optimization through bayesian active learning

C Hvarfner, E Hellsten, F Hutter… - Advances in Neural …, 2024 - proceedings.neurips.cc
Gaussian processes are the model of choice in Bayesian optimization and active learning.
Yet, they are highly dependent on cleverly chosen hyperparameters to reach their full …

Optimizing Posterior Samples for Bayesian Optimization via Rootfinding

TA Adebiyi, B Do, R Zhang - arxiv preprint arxiv:2410.22322, 2024 - arxiv.org
Bayesian optimization devolves the global optimization of a costly objective function to the
global optimization of a sequence of acquisition functions. This inner-loop optimization can …

SOBER: Highly parallel Bayesian optimization and Bayesian quadrature over discrete and mixed spaces

M Adachi, S Hayakawa, S Hamid, M Jørgensen… - arxiv preprint arxiv …, 2023 - arxiv.org
Batch Bayesian optimisation and Bayesian quadrature have been shown to be sample-
efficient methods of performing optimisation and quadrature where expensive-to-evaluate …

Transition Constrained Bayesian Optimization via Markov Decision Processes

JP Folch, C Tsay, RM Lee, B Shafei… - arxiv preprint arxiv …, 2024 - arxiv.org
Bayesian optimization is a methodology to optimize black-box functions. Traditionally, it
focuses on the setting where you can arbitrarily query the search space. However, many real …

Domain-agnostic batch Bayesian optimization with diverse constraints via Bayesian quadrature

M Adachi, S Hayakawa, X Wan, M Jørgensen… - arxiv preprint arxiv …, 2023 - arxiv.org
Real-world optimisation problems often feature complex combinations of (1) diverse
constraints,(2) discrete and mixed spaces, and are (3) highly parallelisable.(4) There are …