[HTML][HTML] A comparison review of transfer learning and self-supervised learning: Definitions, applications, advantages and limitations

Z Zhao, L Alzubaidi, J Zhang, Y Duan, Y Gu - Expert Systems with …, 2024 - Elsevier
Deep learning has emerged as a powerful tool in various domains, revolutionising machine
learning research. However, one persistent challenge is the scarcity of labelled training …

A review of deep learning techniques for speech processing

A Mehrish, N Majumder, R Bharadwaj, R Mihalcea… - Information …, 2023 - Elsevier
The field of speech processing has undergone a transformative shift with the advent of deep
learning. The use of multiple processing layers has enabled the creation of models capable …

Self-supervised speech representation learning: A review

A Mohamed, H Lee, L Borgholt… - IEEE Journal of …, 2022 - ieeexplore.ieee.org
Although supervised deep learning has revolutionized speech and audio processing, it has
necessitated the building of specialist models for individual tasks and application scenarios …

Pushing the limits of simple pipelines for few-shot learning: External data and fine-tuning make a difference

SX Hu, D Li, J Stühmer, M Kim… - Proceedings of the …, 2022 - openaccess.thecvf.com
Few-shot learning (FSL) is an important and topical problem in computer vision that has
motivated extensive research into numerous methods spanning from sophisticated meta …

Spot-the-difference self-supervised pre-training for anomaly detection and segmentation

Y Zou, J Jeong, L Pemula, D Zhang… - European Conference on …, 2022 - Springer
Visual anomaly detection is commonly used in industrial quality inspection. In this paper, we
present a new dataset as well as a new self-supervised learning method for ImageNet pre …

BS3LNet: A New Blind-Spot Self-Supervised Learning Network for Hyperspectral Anomaly Detection

L Gao, D Wang, L Zhuang, X Sun… - … on Geoscience and …, 2023 - ieeexplore.ieee.org
Recent years have witnessed the flourishing of deep learning-based methods in
hyperspectral anomaly detection (HAD). However, the lack of available supervision …

Self-supervised learning for time series analysis: Taxonomy, progress, and prospects

K Zhang, Q Wen, C Zhang, R Cai, M **… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Self-supervised learning (SSL) has recently achieved impressive performance on various
time series tasks. The most prominent advantage of SSL is that it reduces the dependence …

Dual-branch sparse self-learning with instance binding augmentation for adversarial detection in remote sensing images

Z Zhang, X Li, H Li, F Dunkin, B Li… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Remote sensing image analysis technology based on neural networks has significantly
facilitated human life. However, adversarial attacks can drastically impair the performance of …

PDBSNet: Pixel-shuffle downsampling blind-spot reconstruction network for hyperspectral anomaly detection

D Wang, L Zhuang, L Gao, X Sun… - … on Geoscience and …, 2023 - ieeexplore.ieee.org
Recent years have witnessed significant advances of deep learning technology in
hyperspectral anomaly detection (HAD). Among these methods, existing unsupervised …

Switchtab: Switched autoencoders are effective tabular learners

J Wu, S Chen, Q Zhao, R Sergazinov, C Li… - Proceedings of the …, 2024 - ojs.aaai.org
Self-supervised representation learning methods have achieved significant success in
computer vision and natural language processing (NLP), where data samples exhibit explicit …