A survey on deep semi-supervised learning

X Yang, Z Song, I King, Z Xu - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Deep semi-supervised learning is a fast-growing field with a range of practical applications.
This paper provides a comprehensive survey on both fundamentals and recent advances in …

An overview of deep semi-supervised learning

Y Ouali, C Hudelot, M Tami - arxiv preprint arxiv:2006.05278, 2020 - arxiv.org
Deep neural networks demonstrated their ability to provide remarkable performances on a
wide range of supervised learning tasks (eg, image classification) when trained on extensive …

Usb: A unified semi-supervised learning benchmark for classification

Y Wang, H Chen, Y Fan, W Sun… - Advances in …, 2022 - proceedings.neurips.cc
Semi-supervised learning (SSL) improves model generalization by leveraging massive
unlabeled data to augment limited labeled samples. However, currently, popular SSL …

Rethinking pre-training and self-training

B Zoph, G Ghiasi, TY Lin, Y Cui, H Liu… - Advances in neural …, 2020 - proceedings.neurips.cc
Pre-training is a dominant paradigm in computer vision. For example, supervised ImageNet
pre-training is commonly used to initialize the backbones of object detection and …

Big transfer (bit): General visual representation learning

A Kolesnikov, L Beyer, X Zhai, J Puigcerver… - Computer Vision–ECCV …, 2020 - Springer
Transfer of pre-trained representations improves sample efficiency and simplifies
hyperparameter tuning when training deep neural networks for vision. We revisit the …

Self-training with noisy student improves imagenet classification

Q **e, MT Luong, E Hovy… - Proceedings of the IEEE …, 2020 - openaccess.thecvf.com
We present a simple self-training method that achieves 88.4% top-1 accuracy on ImageNet,
which is 2.0% better than the state-of-the-art model that requires 3.5 B weakly labeled …

Pseudo-labeling and confirmation bias in deep semi-supervised learning

E Arazo, D Ortego, P Albert… - … joint conference on …, 2020 - ieeexplore.ieee.org
Semi-supervised learning, ie jointly learning from labeled and unlabeled samples, is an
active research topic due to its key role on relaxing human supervision. In the context of …

Mixmatch: A holistic approach to semi-supervised learning

D Berthelot, N Carlini, I Goodfellow… - Advances in neural …, 2019 - proceedings.neurips.cc
Semi-supervised learning has proven to be a powerful paradigm for leveraging unlabeled
data to mitigate the reliance on large labeled datasets. In this work, we unify the current …

Unsupervised data augmentation for consistency training

Q **e, Z Dai, E Hovy, T Luong… - Advances in neural …, 2020 - proceedings.neurips.cc
Semi-supervised learning lately has shown much promise in improving deep learning
models when labeled data is scarce. Common among recent approaches is the use of …

Semi-supervised and unsupervised deep visual learning: A survey

Y Chen, M Mancini, X Zhu… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
State-of-the-art deep learning models are often trained with a large amount of costly labeled
training data. However, requiring exhaustive manual annotations may degrade the model's …