Advances and open problems in federated learning

P Kairouz, HB McMahan, B Avent… - … and trends® in …, 2021 - nowpublishers.com
Federated learning (FL) is a machine learning setting where many clients (eg, mobile
devices or whole organizations) collaboratively train a model under the orchestration of a …

Privacy-preserving asynchronous vertical federated learning algorithms for multiparty collaborative learning

B Gu, A Xu, Z Huo, C Deng… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
The privacy-preserving federated learning for vertically partitioned (VP) data has shown
promising results as the solution of the emerging multiparty joint modeling application, in …

Revisiting locally supervised learning: an alternative to end-to-end training

Y Wang, Z Ni, S Song, L Yang, G Huang - arxiv preprint arxiv:2101.10832, 2021 - arxiv.org
Due to the need to store the intermediate activations for back-propagation, end-to-end (E2E)
training of deep networks usually suffers from high GPUs memory footprint. This paper aims …

The internet of federated things (IoFT)

R Kontar, N Shi, X Yue, S Chung, E Byon… - IEEE …, 2021 - ieeexplore.ieee.org
The Internet of Things (IoT) is on the verge of a major paradigm shift. In the IoT system of the
future, IoFT, the “cloud” will be substituted by the “crowd” where model training is brought to …

Decoupled greedy learning of cnns

E Belilovsky, M Eickenberg… - … Conference on Machine …, 2020 - proceedings.mlr.press
A commonly cited inefficiency of neural network training by back-propagation is the update
locking problem: each layer must wait for the signal to propagate through the network before …

Multiscale deep bidirectional gated recurrent neural networks based prognostic method for complex non-linear degradation systems

S Behera, R Misra, A Sillitti - Information Sciences, 2021 - Elsevier
Reliable estimation of the remaining useful life (RUL) of complex engineered systems plays
a vital role in avoiding undue maintenance situations while guaranteeing system safety …

Advances in deep learning methods for visual tracking: Literature review and fundamentals

XQ Zhang, RH Jiang, CX Fan, TY Tong, T Wang… - International Journal of …, 2021 - Springer
Recently, deep learning has achieved great success in visual tracking tasks, particularly in
single-object tracking. This paper provides a comprehensive review of state-of-the-art single …

Module-wise training of neural networks via the minimizing movement scheme

S Karkar, I Ayed, E de Bézenac… - Advances in Neural …, 2024 - proceedings.neurips.cc
Greedy layer-wise or module-wise training of neural networks is compelling in constrained
and on-device settings where memory is limited, as it circumvents a number of problems of …

Hpff: Hierarchical locally supervised learning with patch feature fusion

J Su, C He, F Zhu, X Xu, D Guan, C Si - European Conference on …, 2024 - Springer
Traditional deep learning relies on end-to-end backpropagation for training, but it suffers
from drawbacks such as high memory consumption and not aligning with biological neural …

Fine-tuning giant neural networks on commodity hardware with automatic pipeline model parallelism

S Eliad, I Hakimi, A De Jagger, M Silberstein… - 2021 USENIX Annual …, 2021 - usenix.org
Fine-tuning is an increasingly common technique that leverages transfer learning to
dramatically expedite the training of huge, high-quality models. Critically, fine-tuning holds …