Low-parameter federated learning with large language models

J Jiang, H Jiang, Y Ma, X Liu, C Fan - International Conference on Web …, 2024 - Springer
We study few-shot Natural Language Understanding (NLU) tasks with Large Language
Models (LLMs) in federated learning (FL) scenarios, which is challenging due to limited data …

Federated few-shot learning

S Wang, X Fu, K Ding, C Chen, H Chen… - Proceedings of the 29th …, 2023 - dl.acm.org
Federated Learning (FL) enables multiple clients to collaboratively learn a machine learning
model without exchanging their own local data. In this way, the server can exploit the …

Meta knowledge condensation for federated learning

P Liu, X Yu, JT Zhou - arxiv preprint arxiv:2209.14851, 2022 - arxiv.org
Existing federated learning paradigms usually extensively exchange distributed models at a
central solver to achieve a more powerful model. However, this would incur severe …

Autonomy and intelligence in the computing continuum: Challenges, enablers, and future directions for orchestration

H Kokkonen, L Lovén, NH Motlagh, A Kumar… - arxiv preprint arxiv …, 2022 - arxiv.org
Future AI applications require performance, reliability and privacy that the existing, cloud-
dependant system architectures cannot provide. In this article, we study orchestration in the …

[PDF][PDF] Private Semi-Supervised Federated Learning.

C Fan, J Hu, J Huang - IJCAI, 2022 - ijcai.org
We study a federated learning (FL) framework to effectively train models from scarce and
skewly distributed labeled data. We consider a challenging yet practical scenario: a few data …

Federated few-shot learning for mobile nlp

D Cai, S Wang, Y Wu, FX Lin, M Xu - Proceedings of the 29th Annual …, 2023 - dl.acm.org
Natural language processing (NLP) sees rich mobile applications. To support various
language understanding tasks, a foundation NLP model is often fine-tuned in a federated …

Personalized federated few-shot learning

Y Zhao, G Yu, J Wang, C Domeniconi… - … on Neural Networks …, 2022 - ieeexplore.ieee.org
Personalized federated learning (PFL) learns a personalized model for each client in a
decentralized manner, where each client owns private data that are not shared and data …

Federated prompting and chain-of-thought reasoning for improving llms answering

X Liu, T Pang, C Fan - International Conference on Knowledge Science …, 2023 - Springer
We investigate how to enhance answer precision in frequently asked questions posed by
distributed users using cloud-based Large Language Models (LLMs). Our study focuses on …

Adaptive federated few-shot feature learning with prototype rectification

M Yang, X Chu, J Zhu, Y **, S Niu, Z Wang - Engineering Applications of …, 2023 - Elsevier
Targeting to produce new features from limited data, few-shot feature generation
approaches have attracted extensive attention and successfully mitigated the high cost of …

Lightweight industrial image classifier based on federated few-shot learning

X Sun, S Yang, C Zhao - IEEE Transactions on Industrial …, 2022 - ieeexplore.ieee.org
Image classification using convolutional neural networks (CNNs) is critical for broader
industrial applications like defect detection. To protect sensitive data during the industrial …