A critical problem in benchmarking and analysis of evolutionary computation methods

J Kudela - Nature Machine Intelligence, 2022 - nature.com
Benchmarking is a cornerstone in the analysis and development of computational methods,
especially in the field of evolutionary computation, where theoretical analysis of the …

Metaheuristic optimization of power and energy systems: Underlying principles and main issues of the 'rush to heuristics'

G Chicco, A Mazza - Energies, 2020 - mdpi.com
In the power and energy systems area, a progressive increase of literature contributions that
contain applications of metaheuristic algorithms is occurring. In many cases, these …

COCO: A platform for comparing continuous optimizers in a black-box setting

N Hansen, A Auger, R Ros, O Mersmann… - Optimization Methods …, 2021 - Taylor & Francis
We introduce COCO, an open-source platform for Comparing Continuous Optimizers in a
black-box setting. COCO aims at automatizing the tedious and repetitive task of …

HPOBench: A collection of reproducible multi-fidelity benchmark problems for HPO

K Eggensperger, P Müller, N Mallik, M Feurer… - arxiv preprint arxiv …, 2021 - arxiv.org
To achieve peak predictive performance, hyperparameter optimization (HPO) is a crucial
component of machine learning and its applications. Over the last years, the number of …

Designing new metaheuristics: manual versus automatic approaches

CL Camacho-Villalón, T Stützle, M Dorigo - Intelligent Computing, 2023 - spj.science.org
A metaheuristic is a collection of algorithmic concepts that can be used to define heuristic
methods applicable to a wide set of optimization problems for which exact/analytical …

MetaBox: a benchmark platform for meta-black-box optimization with reinforcement learning

Z Ma, H Guo, J Chen, Z Li, G Peng… - Advances in …, 2024 - proceedings.neurips.cc
Abstract Recently, Meta-Black-Box Optimization with Reinforcement Learning (MetaBBO-
RL) has showcased the power of leveraging RL at the meta-level to mitigate manual fine …

IOHanalyzer: Detailed performance analyses for iterative optimization heuristics

H Wang, D Vermetten, F Ye, C Doerr… - ACM Transactions on …, 2022 - dl.acm.org
Benchmarking and performance analysis play an important role in understanding the
behaviour of iterative optimization heuristics (IOHs) such as local search algorithms, genetic …

Benchmarking discrete optimization heuristics with IOHprofiler

C Doerr, F Ye, N Horesh, H Wang, OM Shir… - Proceedings of the …, 2019 - dl.acm.org
Automated benchmarking environments aim to support researchers in understanding how
different algorithms perform on different types of optimization problems. Such comparisons …

Automated dynamic algorithm configuration

S Adriaensen, A Biedenkapp, G Shala, N Awad… - Journal of Artificial …, 2022 - jair.org
The performance of an algorithm often critically depends on its parameter configuration.
While a variety of automated algorithm configuration methods have been proposed to …

Iohexperimenter: Benchmarking platform for iterative optimization heuristics

J de Nobel, F Ye, D Vermetten, H Wang… - Evolutionary …, 2024 - direct.mit.edu
We present IOHexperimenter, the experimentation module of the IOHprofiler project.
IOHexperimenter aims at providing an easy-to-use and customizable toolbox for …