A survey on heterogeneous federated learning

D Gao, X Yao, Q Yang - arxiv preprint arxiv:2210.04505, 2022 - arxiv.org
Federated learning (FL) has been proposed to protect data privacy and virtually assemble
the isolated data silos by cooperatively training models among organizations without …

Sparse random networks for communication-efficient federated learning

B Isik, F Pase, D Gunduz, T Weissman… - arxiv preprint arxiv …, 2022 - arxiv.org
One main challenge in federated learning is the large communication cost of exchanging
weight updates from clients to the server at each round. While prior work has made great …

Device-Wise Federated Network Pruning

S Gao, J Li, Z Zhang, Y Zhang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Neural network pruning particularly channel pruning is a widely used technique for
compressing deep learning models to enable their deployment on edge devices with limited …

Minimax demographic group fairness in federated learning

A Papadaki, N Martinez, M Bertran, G Sapiro… - Proceedings of the …, 2022 - dl.acm.org
Federated learning is an increasingly popular paradigm that enables a large number of
entities to collaboratively learn better models. In this work, we study minimax group fairness …

Timelyfl: Heterogeneity-aware asynchronous federated learning with adaptive partial training

T Zhang, L Gao, S Lee, M Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract In cross-device Federated Learning (FL) environments, scaling synchronous FL
methods is challenging as stragglers hinder the training process. Moreover, the availability …

Fairness and privacy preserving in federated learning: A survey

TH Rafi, FA Noor, T Hussain, DK Chae - Information Fusion, 2024 - Elsevier
Federated Learning (FL) is an increasingly popular form of distributed machine learning that
addresses privacy concerns by allowing participants to collaboratively train machine …

FedMef: Towards Memory-efficient Federated Dynamic Pruning

H Huang, W Zhuang, C Chen… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Federated learning (FL) promotes decentralized training while prioritizing data
confidentiality. However its application on resource-constrained devices is challenging due …

FedSpaLLM: Federated pruning of large language models

G Bai, Y Li, Z Li, L Zhao, K Kim - arxiv preprint arxiv:2410.14852, 2024 - arxiv.org
Large Language Models (LLMs) achieve state-of-the-art performance but are challenging to
deploy due to their high computational and storage demands. Pruning can reduce model …

Distributed pruning towards tiny neural networks in federated learning

H Huang, L Zhang, C Sun, R Fang… - 2023 IEEE 43rd …, 2023 - ieeexplore.ieee.org
Neural network pruning is an essential technique for reducing the size and complexity of
deep neural networks, enabling large-scale models on devices with limited resources …

FedTiny: Pruned federated learning towards specialized tiny models

H Huang, L Zhang, C Sun, R Fang, X Yuan, D Wu - 2022 - openreview.net
Neural network pruning has been a well-established compression technique to enable deep
learning models on resource-constrained devices. The pruned model is usually specialized …