Federated large language model: A position paper

C Chen, X Feng, J Zhou, J Yin, X Zheng - arxiv e-prints, 2023 - ui.adsabs.harvard.edu
Large scale language models (LLM) have received significant attention and found diverse
applications across various domains, but their development encounters challenges in real …

Is heterogeneity notorious? taming heterogeneity to handle test-time shift in federated learning

Y Tan, C Chen, W Zhuang, X Dong… - Advances in Neural …, 2024 - proceedings.neurips.cc
Federated learning (FL) is an effective machine learning paradigm where multiple clients
can train models based on heterogeneous data in a decentralized manner without …

Integration of large language models and federated learning

C Chen, X Feng, Y Li, L Lyu, J Zhou, X Zheng, J Yin - Patterns, 2024 - cell.com
As the parameter size of large language models (LLMs) continues to expand, there is an
urgent need to address the scarcity of high-quality data. In response, existing research has …

Coala: A practical and vision-centric federated learning platform

W Zhuang, J Xu, C Chen, J Li, L Lyu - arxiv preprint arxiv:2407.16560, 2024 - arxiv.org
We present COALA, a vision-centric Federated Learning (FL) platform, and a suite of
benchmarks for practical FL scenarios, which we categorize into three levels: task, data, and …

FedMef: Towards Memory-efficient Federated Dynamic Pruning

H Huang, W Zhuang, C Chen… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Federated learning (FL) promotes decentralized training while prioritizing data
confidentiality. However its application on resource-constrained devices is challenging due …

FedHCA2: Towards Hetero-Client Federated Multi-Task Learning

Y Lu, S Huang, Y Yang, S Sirejiding… - Proceedings of the …, 2024 - openaccess.thecvf.com
Federated Learning (FL) enables joint training across distributed clients using their local
data privately. Federated Multi-Task Learning (FMTL) builds on FL to handle multiple tasks …

Towards Hetero-Client Federated Multi-Task Learning

Y Lu, S Huang, Y Yang, S Sirejiding, Y Ding… - arxiv preprint arxiv …, 2023 - arxiv.org
Federated Learning (FL) enables joint training across distributed clients using their local
data privately. Federated Multi-Task Learning (FMTL) builds on FL to handle multiple tasks …

Identifying Protein-Nucleotide Binding Residues via Grouped Multi-task Learning and Pre-trained Protein Language Models

J Wu, Y Liu, Y Zhang, X Wang, H Yan… - Journal of Chemical …, 2025 - ACS Publications
The accurate identification of protein-nucleotide binding residues is crucial for protein
function annotation and drug discovery. Numerous computational methods have been …

Patching in Order: Efficient On-Device Model Fine-Tuning for Multi-DNN Vision Applications

Z Cao, Y Cheng, Z Zhou, A Lu, Y Hu… - IEEE Transactions …, 2024 - ieeexplore.ieee.org
The increasing deployment of multiple deep neural networks (DNNs) on edge devices is
revolutionizing mobile vision applications, spanning autonomous vehicles, augmented …

Federated Multi-Task Learning on Non-IID Data Silos: An Experimental Study

Y Yang, Y Lu, S Huang, S Sirejiding, H Lu… - Proceedings of the 2024 …, 2024 - dl.acm.org
The innovative Federated Multi-Task Learning (FMTL) approach consolidates the benefits of
Federated Learning (FL) and Multi-Task Learning (MTL), enabling collaborative model …