Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges

B Bischl, M Binder, M Lang, T Pielok… - … : Data Mining and …, 2023 - Wiley Online Library
Most machine learning algorithms are configured by a set of hyperparameters whose values
must be carefully chosen and which often considerably impact performance. To avoid a time …

Machine learning for quantum mechanics in a nutshell

M Rupp - International Journal of Quantum Chemistry, 2015 - Wiley Online Library
Models that combine quantum mechanics (QM) with machine learning (ML) promise to
deliver the accuracy of QM at the speed of ML. This hands‐on tutorial introduces the reader …

[PDF][PDF] Hyperparameter optimization

M Feurer, F Hutter - Automated machine learning: Methods …, 2019 - library.oapen.org
Recent interest in complex and computationally expensive machine learning models with
many hyperparameters, such as automated machine learning (AutoML) frameworks and …

Efficient and robust automated machine learning

M Feurer, A Klein, K Eggensperger… - Advances in neural …, 2015 - proceedings.neurips.cc
The success of machine learning in a broad range of applications has led to an ever-
growing demand for machine learning systems that can be used off the shelf by non-experts …

Tunability: Importance of hyperparameters of machine learning algorithms

P Probst, AL Boulesteix, B Bischl - Journal of Machine Learning Research, 2019 - jmlr.org
Modern supervised machine learning algorithms involve hyperparameters that have to be
set before running them. Options for setting hyperparameters are default values from the …

[PDF][PDF] On over-fitting in model selection and subsequent selection bias in performance evaluation

GC Cawley, NLC Talbot - The Journal of Machine Learning Research, 2010 - jmlr.org
Abstract Model selection strategies for machine learning algorithms typically involve the
numerical optimisation of an appropriate model selection criterion, often based on an …

Auto-sklearn 2.0: Hands-free automl via meta-learning

M Feurer, K Eggensperger, S Falkner… - Journal of Machine …, 2022 - jmlr.org
Automated Machine Learning (AutoML) supports practitioners and researchers with the
tedious task of designing machine learning pipelines and has recently achieved substantial …

What is an optimal value of k in k-fold cross-validation in discrete Bayesian network analysis?

BG Marcot, AM Hanea - Computational Statistics, 2021 - Springer
Cross-validation using randomized subsets of data—known as k-fold cross-validation—is a
powerful means of testing the success rate of models used for classification. However, few if …

Sparse signal recovery with temporally correlated source vectors using sparse Bayesian learning

Z Zhang, BD Rao - IEEE Journal of Selected Topics in Signal …, 2011 - ieeexplore.ieee.org
We address the sparse signal recovery problem in the context of multiple measurement
vectors (MMV) when elements in each nonzero row of the solution matrix are temporally …

[PDF][PDF] The'K'in K-fold Cross Validation.

D Anguita, L Ghelardoni, A Ghio, L Oneto, S Ridella - ESANN, 2012 - esann.org
The K-fold Cross Validation (KCV) technique is one of the most used approaches by
practitioners for model selection and error estimation of classifiers. The KCV consists in …