Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges

B Bischl, M Binder, M Lang, T Pielok… - … : Data Mining and …, 2023 - Wiley Online Library
Most machine learning algorithms are configured by a set of hyperparameters whose values
must be carefully chosen and which often considerably impact performance. To avoid a time …

Recent advances in differential evolution–an updated survey

S Das, SS Mullick, PN Suganthan - Swarm and evolutionary computation, 2016 - Elsevier
Differential Evolution (DE) is arguably one of the most powerful and versatile evolutionary
optimizers for the continuous parameter spaces in recent times. Almost 5 years have passed …

SMAC3: A versatile Bayesian optimization package for hyperparameter optimization

M Lindauer, K Eggensperger, M Feurer… - Journal of Machine …, 2022 - jmlr.org
Algorithm parameters, in particular hyperparameters of machine learning algorithms, can
substantially impact their performance. To support users in determining well-performing …

Tunability: Importance of hyperparameters of machine learning algorithms

P Probst, AL Boulesteix, B Bischl - Journal of Machine Learning Research, 2019 - jmlr.org
Modern supervised machine learning algorithms involve hyperparameters that have to be
set before running them. Options for setting hyperparameters are default values from the …

Auto-WEKA 2.0: Automatic model selection and hyperparameter optimization in WEKA

L Kotthoff, C Thornton, HH Hoos, F Hutter… - Journal of Machine …, 2017 - jmlr.org
WEKA is a widely used, open-source machine learning platform. Due to its intuitive interface,
it is particularly popular with novice users. However, such users often find it hard to identify …

Auto-WEKA: Combined selection and hyperparameter optimization of classification algorithms

C Thornton, F Hutter, HH Hoos… - Proceedings of the 19th …, 2013 - dl.acm.org
Many different machine learning algorithms exist; taking into account each algorithm's
hyperparameters, there is a staggeringly large number of possible alternatives overall. We …

Bio-inspired computation: Where we stand and what's next

J Del Ser, E Osaba, D Molina, XS Yang… - Swarm and Evolutionary …, 2019 - Elsevier
In recent years, the research community has witnessed an explosion of literature dealing
with the mimicking of behavioral patterns and social phenomena observed in nature towards …

[HTML][HTML] Performance assessment and exhaustive listing of 500+ nature-inspired metaheuristic algorithms

Z Ma, G Wu, PN Suganthan, A Song, Q Luo - Swarm and Evolutionary …, 2023 - Elsevier
Metaheuristics are popularly used in various fields, and they have attracted much attention
in the scientific and industrial communities. In recent years, the number of new metaheuristic …

Automated algorithm selection: Survey and perspectives

P Kerschke, HH Hoos, F Neumann… - Evolutionary …, 2019 - ieeexplore.ieee.org
It has long been observed that for practically any computational problem that has been
intensely studied, different instances are best solved using different algorithms. This is …

Multi-objective counterfactual explanations

S Dandl, C Molnar, M Binder, B Bischl - International conference on …, 2020 - Springer
Counterfactual explanations are one of the most popular methods to make predictions of
black box machine learning models interpretable by providing explanations in the form of …