Dataset cartography: Map** and diagnosing datasets with training dynamics

S Swayamdipta, R Schwartz, N Lourie, Y Wang… - arxiv preprint arxiv …, 2020 - arxiv.org
Large datasets have become commonplace in NLP research. However, the increased
emphasis on data quantity has made it challenging to assess the quality of data. We …

Deep model fusion: A survey

W Li, Y Peng, M Zhang, L Ding, H Hu… - arxiv preprint arxiv …, 2023 - arxiv.org
Deep model fusion/merging is an emerging technique that merges the parameters or
predictions of multiple deep learning models into a single one. It combines the abilities of …

Over-the-air federated learning from heterogeneous data

T Sery, N Shlezinger, K Cohen… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
We focus on over-the-air (OTA) Federated Learning (FL), which has been suggested
recently to reduce the communication overhead of FL due to the repeated transmissions of …

Iterative back-translation for neural machine translation

CDV Hoang, P Koehn, G Haffari… - 2nd Workshop on Neural …, 2018 - research.ed.ac.uk
We present iterative back-translation, a method for generating increasingly better synthetic
parallel data from monolingual data to train neural machine translation systems. Our …

Bayesian low-rank adaptation for large language models

AX Yang, M Robeyns, X Wang, L Aitchison - arxiv preprint arxiv …, 2023 - arxiv.org
Low-rank adaptation (LoRA) has emerged as a new paradigm for cost-efficient fine-tuning of
large language models (LLMs). However, fine-tuned LLMs often become overconfident …

Convolutional neural network ensemble for Parkinson's disease detection from voice recordings

M Hireš, M Gazda, P Drotár, ND Pah, MA Motin… - Computers in biology …, 2022 - Elsevier
The computerized detection of Parkinson's disease (PD) will facilitate population screening
and frequent monitoring and provide a more objective measure of symptoms, benefiting both …

Hybrid blended deep learning approach for milk quality analysis

RU Mhapsekar, N O'Shea, S Davy… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
There has been an increase in the implementation of Artificial Intelligence (AI) in the dairy
industry for Milk Quality Analysis (MQA). However, traditional Machine Learning (ML) …

Scale-aware transformers for diagnosing melanocytic lesions

W Wu, S Mehta, S Nofallah, S Knezevich, CJ May… - IEEE …, 2021 - ieeexplore.ieee.org
Diagnosing melanocytic lesions is one of the most challenging areas of pathology with
extensive intra-and inter-observer variability. The gold standard for a diagnosis of invasive …

Uncertainty-driven trustworthy defect detection for high-resolution powder bed images in selective laser melting

Z Zhao, W Liu, J Ren, C Wang, Y He, X Zhang… - Journal of Manufacturing …, 2024 - Elsevier
Selective laser melting (SLM) is known as one of the most promising metal additive
manufacturing technologies, and how to ensure its consistent quality is still a main …

Auto-ensemble: An adaptive learning rate scheduling based deep learning model ensembling

J Yang, F Wang - IEEE Access, 2020 - ieeexplore.ieee.org
Ensembling deep learning models is a shortcut to promote its implementation in new
scenarios, which can avoid tuning neural networks, losses and training algorithms from …