Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges
Most machine learning algorithms are configured by a set of hyperparameters whose values
must be carefully chosen and which often considerably impact performance. To avoid a time …
must be carefully chosen and which often considerably impact performance. To avoid a time …
On hyperparameter optimization of machine learning algorithms: Theory and practice
Abstract Machine learning algorithms have been used widely in various applications and
areas. To fit a machine learning model into different problems, its hyper-parameters must be …
areas. To fit a machine learning model into different problems, its hyper-parameters must be …
Bayesian optimization is superior to random search for machine learning hyperparameter tuning: Analysis of the black-box optimization challenge 2020
This paper presents the results and insights from the black-box optimization (BBO)
challenge at NeurIPS2020 which ran from July–October, 2020. The challenge emphasized …
challenge at NeurIPS2020 which ran from July–October, 2020. The challenge emphasized …
Bio-inspired computation: Where we stand and what's next
In recent years, the research community has witnessed an explosion of literature dealing
with the mimicking of behavioral patterns and social phenomena observed in nature towards …
with the mimicking of behavioral patterns and social phenomena observed in nature towards …
A test-suite of non-convex constrained optimization problems from the real-world and some baseline results
Real-world optimization problems have been comparatively difficult to solve due to the
complex nature of the objective function with a substantial number of constraints. To deal …
complex nature of the objective function with a substantial number of constraints. To deal …
Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems
This work proposes two novel optimization algorithms called Salp Swarm Algorithm (SSA)
and Multi-objective Salp Swarm Algorithm (MSSA) for solving optimization problems with …
and Multi-objective Salp Swarm Algorithm (MSSA) for solving optimization problems with …
Automated algorithm selection: Survey and perspectives
It has long been observed that for practically any computational problem that has been
intensely studied, different instances are best solved using different algorithms. This is …
intensely studied, different instances are best solved using different algorithms. This is …
A critical problem in benchmarking and analysis of evolutionary computation methods
J Kudela - Nature Machine Intelligence, 2022 - nature.com
Benchmarking is a cornerstone in the analysis and development of computational methods,
especially in the field of evolutionary computation, where theoretical analysis of the …
especially in the field of evolutionary computation, where theoretical analysis of the …
Introductory overview: Optimization using evolutionary algorithms and other metaheuristics
Environmental models are used extensively to evaluate the effectiveness of a range of
design, planning, operational, management and policy options. However, the number of …
design, planning, operational, management and policy options. However, the number of …
A survey on high-dimensional Gaussian process modeling with application to Bayesian optimization
Bayesian Optimization (BO), the application of Bayesian function approximation to finding
optima of expensive functions, has exploded in popularity in recent years. In particular, much …
optima of expensive functions, has exploded in popularity in recent years. In particular, much …