Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges
Most machine learning algorithms are configured by a set of hyperparameters whose values
must be carefully chosen and which often considerably impact performance. To avoid a time …
must be carefully chosen and which often considerably impact performance. To avoid a time …
Recent advances in differential evolution–an updated survey
Differential Evolution (DE) is arguably one of the most powerful and versatile evolutionary
optimizers for the continuous parameter spaces in recent times. Almost 5 years have passed …
optimizers for the continuous parameter spaces in recent times. Almost 5 years have passed …
SMAC3: A versatile Bayesian optimization package for hyperparameter optimization
Algorithm parameters, in particular hyperparameters of machine learning algorithms, can
substantially impact their performance. To support users in determining well-performing …
substantially impact their performance. To support users in determining well-performing …
Tunability: Importance of hyperparameters of machine learning algorithms
Modern supervised machine learning algorithms involve hyperparameters that have to be
set before running them. Options for setting hyperparameters are default values from the …
set before running them. Options for setting hyperparameters are default values from the …
Auto-WEKA 2.0: Automatic model selection and hyperparameter optimization in WEKA
WEKA is a widely used, open-source machine learning platform. Due to its intuitive interface,
it is particularly popular with novice users. However, such users often find it hard to identify …
it is particularly popular with novice users. However, such users often find it hard to identify …
Auto-WEKA: Combined selection and hyperparameter optimization of classification algorithms
Many different machine learning algorithms exist; taking into account each algorithm's
hyperparameters, there is a staggeringly large number of possible alternatives overall. We …
hyperparameters, there is a staggeringly large number of possible alternatives overall. We …
Bio-inspired computation: Where we stand and what's next
In recent years, the research community has witnessed an explosion of literature dealing
with the mimicking of behavioral patterns and social phenomena observed in nature towards …
with the mimicking of behavioral patterns and social phenomena observed in nature towards …
[HTML][HTML] Performance assessment and exhaustive listing of 500+ nature-inspired metaheuristic algorithms
Metaheuristics are popularly used in various fields, and they have attracted much attention
in the scientific and industrial communities. In recent years, the number of new metaheuristic …
in the scientific and industrial communities. In recent years, the number of new metaheuristic …
Automated algorithm selection: Survey and perspectives
It has long been observed that for practically any computational problem that has been
intensely studied, different instances are best solved using different algorithms. This is …
intensely studied, different instances are best solved using different algorithms. This is …
Multi-objective counterfactual explanations
Counterfactual explanations are one of the most popular methods to make predictions of
black box machine learning models interpretable by providing explanations in the form of …
black box machine learning models interpretable by providing explanations in the form of …