End-to-end transformer-based models in textual-based NLP

A Rahali, MA Akhloufi - AI, 2023 - mdpi.com
Transformer architectures are highly expressive because they use self-attention
mechanisms to encode long-range dependencies in the input sequences. In this paper, we …

Speed up federated learning in heterogeneous environments: a dynamic tiering approach

SMS Mohammadabadi, S Zawad… - IEEE Internet of Things …, 2024 - ieeexplore.ieee.org
Federated learning enables collaborative training of a model while kee** the training data
decentralized and private. However, in IoT systems, inherent heterogeneity in processing …

Federated Learning For IoT: Applications, Trends, Taxonomy, Challenges, Current Solutions, and Future Directions

M Adam, U Baroud - IEEE Open Journal of the …, 2024 - ieeexplore.ieee.org
The rapid advancement of Internet of Things (IoT) technology has transformed the digital
landscape, enabling unprecedented connectivity between devices, people, and services …

Worldwide federated training of language models

A Iacob, L Sani, B Marino, P Aleksandrov… - arxiv preprint arxiv …, 2024 - arxiv.org
The reliance of language model training on massive amounts of computation and vast
datasets scraped from potentially low-quality, copyrighted, or sensitive data has come into …

A privacy-preserving subgraph-level federated graph neural network via differential privacy

Y Qiu, C Huang, J Wang, Z Huang, J **ao - International Conference on …, 2022 - Springer
Currently, the federated graph neural network (GNN) has attracted a lot of attention due to its
wide applications in reality without violating the privacy regulations. Among all the privacy …

Collaborative semantic aggregation and calibration for federated domain generalization

J Yuan, X Ma, D Chen, F Wu, L Lin… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Domain generalization (DG) aims to learn from multiple known source domains a model that
can generalize well to unknown target domains. The existing DG methods usually exploit the …

Federated Learning Survey: A Multi-Level Taxonomy of Aggregation Techniques, Experimental Insights, and Future Frontiers

M Arbaoui, MA Brahmia, A Rahmoun… - ACM Transactions on …, 2024 - dl.acm.org
The emerging integration of Internet of Things (IoT) and AI has unlocked numerous
opportunities for innovation across diverse industries. However, growing privacy concerns …

Adapter-based Selective Knowledge Distillation for Federated Multi-domain Meeting Summarization

X Feng, X Feng, X Du, MY Kan… - IEEE/ACM Transactions …, 2024 - ieeexplore.ieee.org
Meeting summarization has emerged as a promising technique for providing users with
condensed summaries. However, existing work has focused on training models on …

Training Machine Learning models at the Edge: A Survey

AR Khouas, MR Bouadjenek, H Hacid… - arxiv preprint arxiv …, 2024 - arxiv.org
Edge Computing (EC) has gained significant traction in recent years, promising enhanced
efficiency by integrating Artificial Intelligence (AI) capabilities at the edge. While the focus …

Federated learning-based natural language processing: a systematic literature review

Y Khan, D Sánchez, J Domingo-Ferrer - Artificial Intelligence Review, 2024 - Springer
Federated learning (FL) is a decentralized machine learning (ML) framework that allows
models to be trained without sharing the participants' local data. FL thus preserves privacy …