Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges

B Bischl, M Binder, M Lang, T Pielok… - … : Data Mining and …, 2023 - Wiley Online Library
Most machine learning algorithms are configured by a set of hyperparameters whose values
must be carefully chosen and which often considerably impact performance. To avoid a time …

On hyperparameter optimization of machine learning algorithms: Theory and practice

L Yang, A Shami - Neurocomputing, 2020 - Elsevier
Abstract Machine learning algorithms have been used widely in various applications and
areas. To fit a machine learning model into different problems, its hyper-parameters must be …

Deep learning for time series forecasting: a survey

JF Torres, D Hadjout, A Sebaa, F Martínez-Álvarez… - Big data, 2021 - liebertpub.com
Time series forecasting has become a very intensive field of research, which is even
increasing in recent years. Deep neural networks have proved to be powerful and are …

Hyper-parameter optimization: A review of algorithms and applications

T Yu, H Zhu - arxiv preprint arxiv:2003.05689, 2020 - arxiv.org
Since deep neural networks were developed, they have made huge contributions to
everyday lives. Machine learning provides more rational advice than humans are capable of …

[ΒΙΒΛΙΟ][B] Hyperparameter optimization

M Feurer, F Hutter - 2019 - library.oapen.org
Recent interest in complex and computationally expensive machine learning models with
many hyperparameters, such as automated machine learning (AutoML) frameworks and …

[ΒΙΒΛΙΟ][B] Automated machine learning: methods, systems, challenges

F Hutter, L Kotthoff, J Vanschoren - 2019 - library.oapen.org
This open access book presents the first comprehensive overview of general methods in
Automated Machine Learning (AutoML), collects descriptions of existing systems based on …

Automated machine learning: past, present and future

M Baratchi, C Wang, S Limmer, JN van Rijn… - Artificial intelligence …, 2024 - Springer
Automated machine learning (AutoML) is a young research area aiming at making high-
performance machine learning techniques accessible to a broad set of users. This is …

Nas-bench-101: Towards reproducible neural architecture search

C Ying, A Klein, E Christiansen, E Real… - International …, 2019 - proceedings.mlr.press
Recent advances in neural architecture search (NAS) demand tremendous computational
resources, which makes it difficult to reproduce experiments and imposes a barrier-to-entry …

BOHB: Robust and efficient hyperparameter optimization at scale

S Falkner, A Klein, F Hutter - International conference on …, 2018 - proceedings.mlr.press
Modern deep learning methods are very sensitive to many hyperparameters, and, due to the
long training times of state-of-the-art models, vanilla Bayesian hyperparameter optimization …

Benchmark and survey of automated machine learning frameworks

MA Zöller, MF Huber - Journal of artificial intelligence research, 2021 - jair.org
Abstract Machine learning (ML) has become a vital part in many aspects of our daily life.
However, building well performing machine learning applications requires highly …