Eight years of AutoML: categorisation, review and trends
Abstract Knowledge extraction through machine learning techniques has been successfully
applied in a large number of application domains. However, apart from the required …
applied in a large number of application domains. However, apart from the required …
Graph contrastive learning automated
Self-supervised learning on graph-structured data has drawn recent interest for learning
generalizable, transferable and robust representations from unlabeled graphs. Among …
generalizable, transferable and robust representations from unlabeled graphs. Among …
Automated deep learning: Neural architecture search is not the end
Deep learning (DL) has proven to be a highly effective approach for develo** models in
diverse contexts, including visual perception, speech recognition, and machine translation …
diverse contexts, including visual perception, speech recognition, and machine translation …
Meta-learning in neural networks: A survey
The field of meta-learning, or learning-to-learn, has seen a dramatic rise in interest in recent
years. Contrary to conventional approaches to AI where tasks are solved from scratch using …
years. Contrary to conventional approaches to AI where tasks are solved from scratch using …
Advances and open problems in federated learning
Federated learning (FL) is a machine learning setting where many clients (eg, mobile
devices or whole organizations) collaboratively train a model under the orchestration of a …
devices or whole organizations) collaboratively train a model under the orchestration of a …
Efficient and modular implicit differentiation
Automatic differentiation (autodiff) has revolutionized machine learning. Itallows to express
complex computations by composing elementary ones in creativeways and removes the …
complex computations by composing elementary ones in creativeways and removes the …
AutoML: A survey of the state-of-the-art
Deep learning (DL) techniques have obtained remarkable achievements on various tasks,
such as image recognition, object detection, and language modeling. However, building a …
such as image recognition, object detection, and language modeling. However, building a …
Meta-learning with implicit gradients
A core capability of intelligent systems is the ability to quickly learn new tasks by drawing on
prior experience. Gradient (or optimization) based meta-learning has recently emerged as …
prior experience. Gradient (or optimization) based meta-learning has recently emerged as …
[PDF][PDF] Hyperparameter optimization
Recent interest in complex and computationally expensive machine learning models with
many hyperparameters, such as automated machine learning (AutoML) frameworks and …
many hyperparameters, such as automated machine learning (AutoML) frameworks and …
Learning-rate-free learning by d-adaptation
A Defazio, K Mishchenko - International Conference on …, 2023 - proceedings.mlr.press
The speed of gradient descent for convex Lipschitz functions is highly dependent on the
choice of learning rate. Setting the learning rate to achieve the optimal convergence rate …
choice of learning rate. Setting the learning rate to achieve the optimal convergence rate …