A survey on curriculum learning

X Wang, Y Chen, W Zhu - IEEE transactions on pattern analysis …, 2021 - ieeexplore.ieee.org
Curriculum learning (CL) is a training strategy that trains a machine learning model from
easier data to harder data, which imitates the meaningful learning order in human curricula …

A comprehensive survey of federated transfer learning: challenges, methods and applications

W Guo, F Zhuang, X Zhang, Y Tong, J Dong - Frontiers of Computer …, 2024 - Springer
Federated learning (FL) is a novel distributed machine learning paradigm that enables
participants to collaboratively train a centralized model with privacy preservation by …

Approximate nearest neighbor negative contrastive learning for dense text retrieval

L **ong, C **ong, Y Li, KF Tang, J Liu… - arxiv preprint arxiv …, 2020 - arxiv.org
Conducting text retrieval in a dense learned representation space has many intriguing
advantages over sparse retrieval. Yet the effectiveness of dense retrieval (DR) often requires …

Tackling system and statistical heterogeneity for federated learning with adaptive client sampling

B Luo, W **ao, S Wang, J Huang… - IEEE INFOCOM 2022 …, 2022 - ieeexplore.ieee.org
Federated learning (FL) algorithms usually sample a fraction of clients in each round (partial
participation) when the number of participants is large and the server's communication …

Efficient training of physics‐informed neural networks via importance sampling

MA Nabian, RJ Gladstone… - Computer‐Aided Civil and …, 2021 - Wiley Online Library
Physics‐informed neural networks (PINNs) are a class of deep neural networks that are
trained, using automatic differentiation, to compute the response of systems governed by …

Think locally, act globally: Federated learning with local and global representations

PP Liang, T Liu, L Ziyin, NB Allen, RP Auerbach… - arxiv preprint arxiv …, 2020 - arxiv.org
Federated learning is a method of training models on private data distributed over multiple
devices. To keep device data private, the global model is trained by only communicating …

PyramidFL: A fine-grained client selection framework for efficient federated learning

C Li, X Zeng, M Zhang, Z Cao - Proceedings of the 28th Annual …, 2022 - dl.acm.org
Federated learning (FL) is an emerging distributed machine learning (ML) paradigm with
enhanced privacy, aiming to achieve a" good" ML model for as many as participants while …

Distributed prioritized experience replay

D Horgan, J Quan, D Budden, G Barth-Maron… - arxiv preprint arxiv …, 2018 - arxiv.org
We propose a distributed architecture for deep reinforcement learning at scale, that enables
agents to learn effectively from orders of magnitude more data than previously possible. The …

Prioritized training on points that are learnable, worth learning, and not yet learnt

S Mindermann, JM Brauner… - International …, 2022 - proceedings.mlr.press
Training on web-scale data can take months. But much computation and time is wasted on
redundant and noisy points that are already learnt or not learnable. To accelerate training …

Not all samples are created equal: Deep learning with importance sampling

A Katharopoulos, F Fleuret - International conference on …, 2018 - proceedings.mlr.press
Abstract Deep Neural Network training spends most of the computation on examples that
are properly handled, and could be ignored. We propose to mitigate this phenomenon with a …