Challenges and applications of large language models

J Kaddour, J Harris, M Mozes, H Bradley… - arxiv preprint arxiv …, 2023 - arxiv.org
Large Language Models (LLMs) went from non-existent to ubiquitous in the machine
learning discourse within a few years. Due to the fast pace of the field, it is difficult to identify …

Recent advances in Bayesian optimization

X Wang, Y **, S Schmitt, M Olhofer - ACM Computing Surveys, 2023 - dl.acm.org
Bayesian optimization has emerged at the forefront of expensive black-box optimization due
to its data efficiency. Recent years have witnessed a proliferation of studies on the …

Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges

B Bischl, M Binder, M Lang, T Pielok… - … : Data Mining and …, 2023 - Wiley Online Library
Most machine learning algorithms are configured by a set of hyperparameters whose values
must be carefully chosen and which often considerably impact performance. To avoid a time …

Uncertainty quantification in machine learning for engineering design and health prognostics: A tutorial

V Nemani, L Biggio, X Huan, Z Hu, O Fink… - … Systems and Signal …, 2023 - Elsevier
On top of machine learning (ML) models, uncertainty quantification (UQ) functions as an
essential layer of safety assurance that could lead to more principled decision making by …

Data quantity governance for machine learning in materials science

Y Liu, Z Yang, X Zou, S Ma, D Liu… - National Science …, 2023 - academic.oup.com
Data-driven machine learning (ML) is widely employed in the analysis of materials structure–
activity relationships, performance optimization and materials design due to its superior …

BoTorch: A framework for efficient Monte-Carlo Bayesian optimization

M Balandat, B Karrer, D Jiang… - Advances in neural …, 2020 - proceedings.neurips.cc
Bayesian optimization provides sample-efficient global optimization for a broad range of
applications, including automatic machine learning, engineering, physics, and experimental …

[КНИГА][B] Hyperparameter optimization

M Feurer, F Hutter - 2019 - library.oapen.org
Recent interest in complex and computationally expensive machine learning models with
many hyperparameters, such as automated machine learning (AutoML) frameworks and …

[КНИГА][B] Automated machine learning: methods, systems, challenges

F Hutter, L Kotthoff, J Vanschoren - 2019 - library.oapen.org
This open access book presents the first comprehensive overview of general methods in
Automated Machine Learning (AutoML), collects descriptions of existing systems based on …

Scalable global optimization via local Bayesian optimization

D Eriksson, M Pearce, J Gardner… - Advances in neural …, 2019 - proceedings.neurips.cc
Bayesian optimization has recently emerged as a popular method for the sample-efficient
optimization of expensive black-box functions. However, the application to high-dimensional …

A tutorial on Bayesian optimization

PI Frazier - arxiv preprint arxiv:1807.02811, 2018 - arxiv.org
Bayesian optimization is an approach to optimizing objective functions that take a long time
(minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of …