A comprehensive survey on regularization strategies in machine learning

Y Tian, Y Zhang - Information Fusion, 2022 - Elsevier
In machine learning, the model is not as complicated as possible. Good generalization
ability means that the model not only performs well on the training data set, but also can …

[HTML][HTML] Deep learning classifiers for hyperspectral imaging: A review

ME Paoletti, JM Haut, J Plaza, A Plaza - ISPRS Journal of Photogrammetry …, 2019 - Elsevier
Advances in computing technology have fostered the development of new and powerful
deep learning (DL) techniques, which have demonstrated promising results in a wide range …

R-drop: Regularized dropout for neural networks

L Wu, J Li, Y Wang, Q Meng, T Qin… - Advances in …, 2021 - proceedings.neurips.cc
Dropout is a powerful and widely used technique to regularize the training of deep neural
networks. Though effective and performing well, the randomness introduced by dropout …

Model compression and hardware acceleration for neural networks: A comprehensive survey

L Deng, G Li, S Han, L Shi, Y **e - Proceedings of the IEEE, 2020 - ieeexplore.ieee.org
Domain-specific hardware is becoming a promising topic in the backdrop of improvement
slow down for general-purpose processors due to the foreseeable end of Moore's Law …

Dice: Leveraging sparsification for out-of-distribution detection

Y Sun, Y Li - European Conference on Computer Vision, 2022 - Springer
Detecting out-of-distribution (OOD) inputs is a central challenge for safely deploying
machine learning models in the real world. Previous methods commonly rely on an OOD …

Transfer learning for medical images analyses: A survey

X Yu, J Wang, QQ Hong, R Teku, SH Wang, YD Zhang - Neurocomputing, 2022 - Elsevier
The advent of deep learning has brought great change to the community of computer
science and also revitalized numerous fields where traditional machine learning methods …

Gridmask data augmentation

P Chen, S Liu, H Zhao, X Wang, J Jia - arxiv preprint arxiv:2001.04086, 2020 - arxiv.org
We propose a novel data augmentation methodGridMask'in this paper. It utilizes information
removal to achieve state-of-the-art results in a variety of computer vision tasks. We analyze …

Dropout reduces underfitting

Z Liu, Z Xu, J **, Z Shen… - … Conference on Machine …, 2023 - proceedings.mlr.press
Introduced by Hinton et al. in 2012, dropout has stood the test of time as a regularizer for
preventing overfitting in neural networks. In this study, we demonstrate that dropout can also …

Social touch gesture recognition using convolutional neural network

S Albawi, O Bayat, S Al-Azawi… - Computational …, 2018 - Wiley Online Library
Recently, social touch gesture recognition has been considered an important topic for touch
modality, which can lead to highly efficient and realistic human‐robot interaction. In this …

Random erasing data augmentation

Z Zhong, L Zheng, G Kang, S Li, Y Yang - Proceedings of the AAAI …, 2020 - ojs.aaai.org
In this paper, we introduce Random Erasing, a new data augmentation method for training
the convolutional neural network (CNN). In training, Random Erasing randomly selects a …