A survey on curriculum learning
Curriculum learning (CL) is a training strategy that trains a machine learning model from
easier data to harder data, which imitates the meaningful learning order in human curricula …
easier data to harder data, which imitates the meaningful learning order in human curricula …
A comprehensive survey of federated transfer learning: challenges, methods and applications
Federated learning (FL) is a novel distributed machine learning paradigm that enables
participants to collaboratively train a centralized model with privacy preservation by …
participants to collaboratively train a centralized model with privacy preservation by …
Approximate nearest neighbor negative contrastive learning for dense text retrieval
Conducting text retrieval in a dense learned representation space has many intriguing
advantages over sparse retrieval. Yet the effectiveness of dense retrieval (DR) often requires …
advantages over sparse retrieval. Yet the effectiveness of dense retrieval (DR) often requires …
Tackling system and statistical heterogeneity for federated learning with adaptive client sampling
Federated learning (FL) algorithms usually sample a fraction of clients in each round (partial
participation) when the number of participants is large and the server's communication …
participation) when the number of participants is large and the server's communication …
Efficient training of physics‐informed neural networks via importance sampling
Physics‐informed neural networks (PINNs) are a class of deep neural networks that are
trained, using automatic differentiation, to compute the response of systems governed by …
trained, using automatic differentiation, to compute the response of systems governed by …
Think locally, act globally: Federated learning with local and global representations
Federated learning is a method of training models on private data distributed over multiple
devices. To keep device data private, the global model is trained by only communicating …
devices. To keep device data private, the global model is trained by only communicating …
PyramidFL: A fine-grained client selection framework for efficient federated learning
Federated learning (FL) is an emerging distributed machine learning (ML) paradigm with
enhanced privacy, aiming to achieve a" good" ML model for as many as participants while …
enhanced privacy, aiming to achieve a" good" ML model for as many as participants while …
Distributed prioritized experience replay
We propose a distributed architecture for deep reinforcement learning at scale, that enables
agents to learn effectively from orders of magnitude more data than previously possible. The …
agents to learn effectively from orders of magnitude more data than previously possible. The …
Prioritized training on points that are learnable, worth learning, and not yet learnt
Training on web-scale data can take months. But much computation and time is wasted on
redundant and noisy points that are already learnt or not learnable. To accelerate training …
redundant and noisy points that are already learnt or not learnable. To accelerate training …
Not all samples are created equal: Deep learning with importance sampling
Abstract Deep Neural Network training spends most of the computation on examples that
are properly handled, and could be ignored. We propose to mitigate this phenomenon with a …
are properly handled, and could be ignored. We propose to mitigate this phenomenon with a …