Knowledge distillation and student-teacher learning for visual intelligence: A review and new outlooks

L Wang, KJ Yoon - IEEE transactions on pattern analysis and …, 2021 - ieeexplore.ieee.org
Deep neural models, in recent years, have been successful in almost every field, even
solving the most complex problem statements. However, these models are huge in size with …

Heterogeneous ensemble knowledge transfer for training large models in federated learning

YJ Cho, A Manoel, G Joshi, R Sim… - arxiv preprint arxiv …, 2022 - arxiv.org
Federated learning (FL) enables edge-devices to collaboratively learn a model without
disclosing their private data to a central aggregating server. Most existing FL algorithms …

[PDF][PDF] 深度学**中知识蒸馏研究综述

邵仁荣, 刘宇昂, 张伟, 王骏 - 计算机学报, 2022 - 159.226.43.17
摘要在人工智能迅速发展的今天, 深度神经网络广泛应用于各个研究领域并取得了巨大的成功,
但也同样面临着诸多挑战. 首先, 为了解决复杂的问题和提高模型的训练效果 …

Master-Slave Policy Collaboration for Actor-Critic Methods

X Li, Q Liu - 2022 International Joint Conference on Neural …, 2022 - ieeexplore.ieee.org
Actor-critic methods of deep reinforcement learning are widely used to address continuous
control tasks. However, the difficulty in balancing exploration and exploitation, as well as the …