End-to-end transformer-based models in textual-based NLP
Transformer architectures are highly expressive because they use self-attention
mechanisms to encode long-range dependencies in the input sequences. In this paper, we …
mechanisms to encode long-range dependencies in the input sequences. In this paper, we …
Speed up federated learning in heterogeneous environments: a dynamic tiering approach
Federated learning enables collaborative training of a model while kee** the training data
decentralized and private. However, in IoT systems, inherent heterogeneity in processing …
decentralized and private. However, in IoT systems, inherent heterogeneity in processing …
Federated Learning For IoT: Applications, Trends, Taxonomy, Challenges, Current Solutions, and Future Directions
M Adam, U Baroud - IEEE Open Journal of the …, 2024 - ieeexplore.ieee.org
The rapid advancement of Internet of Things (IoT) technology has transformed the digital
landscape, enabling unprecedented connectivity between devices, people, and services …
landscape, enabling unprecedented connectivity between devices, people, and services …
Worldwide federated training of language models
The reliance of language model training on massive amounts of computation and vast
datasets scraped from potentially low-quality, copyrighted, or sensitive data has come into …
datasets scraped from potentially low-quality, copyrighted, or sensitive data has come into …
A privacy-preserving subgraph-level federated graph neural network via differential privacy
Currently, the federated graph neural network (GNN) has attracted a lot of attention due to its
wide applications in reality without violating the privacy regulations. Among all the privacy …
wide applications in reality without violating the privacy regulations. Among all the privacy …
Collaborative semantic aggregation and calibration for federated domain generalization
Domain generalization (DG) aims to learn from multiple known source domains a model that
can generalize well to unknown target domains. The existing DG methods usually exploit the …
can generalize well to unknown target domains. The existing DG methods usually exploit the …
Federated Learning Survey: A Multi-Level Taxonomy of Aggregation Techniques, Experimental Insights, and Future Frontiers
The emerging integration of Internet of Things (IoT) and AI has unlocked numerous
opportunities for innovation across diverse industries. However, growing privacy concerns …
opportunities for innovation across diverse industries. However, growing privacy concerns …
Adapter-based Selective Knowledge Distillation for Federated Multi-domain Meeting Summarization
Meeting summarization has emerged as a promising technique for providing users with
condensed summaries. However, existing work has focused on training models on …
condensed summaries. However, existing work has focused on training models on …
Training Machine Learning models at the Edge: A Survey
Edge Computing (EC) has gained significant traction in recent years, promising enhanced
efficiency by integrating Artificial Intelligence (AI) capabilities at the edge. While the focus …
efficiency by integrating Artificial Intelligence (AI) capabilities at the edge. While the focus …
Federated learning-based natural language processing: a systematic literature review
Federated learning (FL) is a decentralized machine learning (ML) framework that allows
models to be trained without sharing the participants' local data. FL thus preserves privacy …
models to be trained without sharing the participants' local data. FL thus preserves privacy …