A comprehensive survey of few-shot learning: Evolution, applications, challenges, and opportunities

Y Song, T Wang, P Cai, SK Mondal… - ACM Computing Surveys, 2023 - dl.acm.org
Few-shot learning (FSL) has emerged as an effective learning method and shows great
potential. Despite the recent creative works in tackling FSL tasks, learning valid information …

Transformers learn in-context by gradient descent

J Von Oswald, E Niklasson… - International …, 2023 - proceedings.mlr.press
At present, the mechanisms of in-context learning in Transformers are not well understood
and remain mostly an intuition. In this paper, we suggest that training Transformers on auto …

A survey of meta-reinforcement learning

J Beck, R Vuorio, EZ Liu, Z **ong, L Zintgraf… - arxiv preprint arxiv …, 2023 - arxiv.org
While deep reinforcement learning (RL) has fueled multiple high-profile successes in
machine learning, it is held back from more widespread adoption by its often poor data …

Fast model editing at scale

E Mitchell, C Lin, A Bosselut, C Finn… - arxiv preprint arxiv …, 2021 - arxiv.org
While large pre-trained models have enabled impressive results on a variety of downstream
tasks, the largest existing models still make errors, and even accurate predictions may …

Few-shot incremental learning with continually evolved classifiers

C Zhang, N Song, G Lin, Y Zheng… - Proceedings of the …, 2021 - openaccess.thecvf.com
Few-shot class-incremental learning (FSCIL) aims to design machine learning algorithms
that can continually learn new concepts from a few data points, without forgetting knowledge …

Meta-learning in neural networks: A survey

T Hospedales, A Antoniou, P Micaelli… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
The field of meta-learning, or learning-to-learn, has seen a dramatic rise in interest in recent
years. Contrary to conventional approaches to AI where tasks are solved from scratch using …

DeepEMD: Few-shot image classification with differentiable earth mover's distance and structured classifiers

C Zhang, Y Cai, G Lin, C Shen - Proceedings of the IEEE …, 2020 - openaccess.thecvf.com
In this paper, we address the few-shot classification task from a new perspective of optimal
matching between image regions. We adopt the Earth Mover's Distance (EMD) as a metric to …

Meta-learning as a promising approach for few-shot cross-domain fault diagnosis: Algorithms, applications, and prospects

Y Feng, J Chen, J **e, T Zhang, H Lv, T Pan - Knowledge-Based Systems, 2022 - Elsevier
The advances of intelligent fault diagnosis in recent years show that deep learning has
strong capability of automatic feature extraction and accurate identification for fault signals …

A closer look at few-shot classification again

X Luo, H Wu, J Zhang, L Gao, J Xu… - … on Machine Learning, 2023 - proceedings.mlr.press
Few-shot classification consists of a training phase where a model is learned on a relatively
large dataset and an adaptation phase where the learned model is adapted to previously …

Sharp-maml: Sharpness-aware model-agnostic meta learning

M Abbas, Q **ao, L Chen, PY Chen… - … on machine learning, 2022 - proceedings.mlr.press
Abstract Model-agnostic meta learning (MAML) is currently one of the dominating
approaches for few-shot meta-learning. Albeit its effectiveness, the optimization of MAML …