Self-supervised speech representation learning: A review

A Mohamed, H Lee, L Borgholt… - IEEE Journal of …, 2022 - ieeexplore.ieee.org
Although supervised deep learning has revolutionized speech and audio processing, it has
necessitated the building of specialist models for individual tasks and application scenarios …

Super-resolution analysis via machine learning: a survey for fluid flows

K Fukami, K Fukagata, K Taira - Theoretical and Computational Fluid …, 2023 - Springer
This paper surveys machine-learning-based super-resolution reconstruction for vortical
flows. Super resolution aims to find the high-resolution flow fields from low-resolution data …

Learning vector-quantized item representation for transferable sequential recommenders

Y Hou, Z He, J McAuley, WX Zhao - … of the ACM Web Conference 2023, 2023 - dl.acm.org
Recently, the generality of natural language text has been leveraged to develop transferable
recommender systems. The basic idea is to employ pre-trained language models (PLM) to …

A unifying review of deep and shallow anomaly detection

L Ruff, JR Kauffmann, RA Vandermeulen… - Proceedings of the …, 2021 - ieeexplore.ieee.org
Deep learning approaches to anomaly detection (AD) have recently improved the state of
the art in detection performance on complex data sets, such as large collections of images or …

Transfer learning in deep reinforcement learning: A survey

Z Zhu, K Lin, AK Jain, J Zhou - IEEE Transactions on Pattern …, 2023 - ieeexplore.ieee.org
Reinforcement learning is a learning paradigm for solving sequential decision-making
problems. Recent years have witnessed remarkable progress in reinforcement learning …

[HTML][HTML] A survey on deep learning-based change detection from high-resolution remote sensing images

H Jiang, M Peng, Y Zhong, H **e, Z Hao, J Lin, X Ma… - Remote Sensing, 2022 - mdpi.com
Change detection based on remote sensing images plays an important role in the field of
remote sensing analysis, and it has been widely used in many areas, such as resources …

Rotating machinery fault-induced vibration signal modulation effects: A review with mechanisms, extraction methods and applications for diagnosis

P Zhou, S Chen, Q He, D Wang, Z Peng - Mechanical Systems and Signal …, 2023 - Elsevier
Rotating machinery faults can induce characteristic modulation effects in a vibration signal,
and their diagnosis can thus be conducted by extracting fault-induced modulation features …

Rethinking pre-training and self-training

B Zoph, G Ghiasi, TY Lin, Y Cui, H Liu… - Advances in neural …, 2020 - proceedings.neurips.cc
Pre-training is a dominant paradigm in computer vision. For example, supervised ImageNet
pre-training is commonly used to initialize the backbones of object detection and …

To compress or not to compress—self-supervised learning and information theory: A review

R Shwartz Ziv, Y LeCun - Entropy, 2024 - mdpi.com
Deep neural networks excel in supervised learning tasks but are constrained by the need for
extensive labeled data. Self-supervised learning emerges as a promising alternative …

Self-supervised learning by cross-modal audio-video clustering

H Alwassel, D Mahajan, B Korbar… - Advances in …, 2020 - proceedings.neurips.cc
Visual and audio modalities are highly correlated, yet they contain different information.
Their strong correlation makes it possible to predict the semantics of one from the other with …