Hyperparameters and tuning strategies for random forest

P Probst, MN Wright… - … Reviews: data mining and …, 2019 - Wiley Online Library
The random forest (RF) algorithm has several hyperparameters that have to be set by the
user, for example, the number of observations drawn randomly for each tree and whether …

Auto-sklearn 2.0: Hands-free automl via meta-learning

M Feurer, K Eggensperger, S Falkner… - Journal of Machine …, 2022 - jmlr.org
Automated Machine Learning (AutoML) supports practitioners and researchers with the
tedious task of designing machine learning pipelines and has recently achieved substantial …

Tunability: Importance of hyperparameters of machine learning algorithms

P Probst, AL Boulesteix, B Bischl - Journal of Machine Learning Research, 2019 - jmlr.org
Modern supervised machine learning algorithms involve hyperparameters that have to be
set before running them. Options for setting hyperparameters are default values from the …

Benchmark and survey of automated machine learning frameworks

MA Zöller, MF Huber - Journal of artificial intelligence research, 2021 - jair.org
Abstract Machine learning (ML) has become a vital part in many aspects of our daily life.
However, building well performing machine learning applications requires highly …

Hyperparameter importance across datasets

JN Van Rijn, F Hutter - Proceedings of the 24th ACM SIGKDD …, 2018 - dl.acm.org
With the advent of automated machine learning, automated hyperparameter optimization
methods are by now routinely used in data mining. However, this progress is not yet …

Priorband: Practical hyperparameter optimization in the age of deep learning

N Mallik, E Bergman, C Hvarfner… - Advances in …, 2023 - proceedings.neurips.cc
Abstract Hyperparameters of Deep Learning (DL) pipelines are crucial for their downstream
performance. While a large number of methods for Hyperparameter Optimization (HPO) …

Model-agnostic feature importance and effects with dependent features: a conditional subgroup approach

C Molnar, G König, B Bischl, G Casalicchio - Data Mining and Knowledge …, 2024 - Springer
The interpretation of feature importance in machine learning models is challenging when
features are dependent. Permutation feature importance (PFI) ignores such dependencies …

End-to-end optimization of machine learning prediction queries

K Park, K Saur, D Banda, R Sen, M Interlandi… - Proceedings of the …, 2022 - dl.acm.org
Prediction queries are widely used across industries to perform advanced analytics and
draw insights from data. They include a data processing part (eg, for joining, filtering …

An ADMM based framework for automl pipeline configuration

S Liu, P Ram, D Vijaykeerthy, D Bouneffouf… - Proceedings of the …, 2020 - ojs.aaai.org
We study the AutoML problem of automatically configuring machine learning pipelines by
jointly selecting algorithms and their appropriate hyper-parameters for all steps in …

Don't dismiss logistic regression: the case for sensible extraction of interactions in the era of machine learning

JJ Levy, AJ O'Malley - BMC medical research methodology, 2020 - Springer
Background Machine learning approaches have become increasingly popular modeling
techniques, relying on data-driven heuristics to arrive at its solutions. Recent comparisons …