[HTML][HTML] Survey on self-supervised learning: auxiliary pretext tasks and contrastive learning methods in imaging

S Albelwi - Entropy, 2022 - mdpi.com
Although deep learning algorithms have achieved significant progress in a variety of
domains, they require costly annotations on huge datasets. Self-supervised learning (SSL) …

Does negative sampling matter? a review with insights into its theory and applications

Z Yang, M Ding, T Huang, Y Cen, J Song… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Negative sampling has swiftly risen to prominence as a focal point of research, with wide-
ranging applications spanning machine learning, computer vision, natural language …

Exploring cross-image pixel contrast for semantic segmentation

W Wang, T Zhou, F Yu, J Dai… - Proceedings of the …, 2021 - openaccess.thecvf.com
Current semantic segmentation methods focus only on mining" local" context, ie,
dependencies between pixels within individual images, by context-aggregation modules …

What to hide from your students: Attention-guided masked image modeling

I Kakogeorgiou, S Gidaris, B Psomas, Y Avrithis… - … on Computer Vision, 2022 - Springer
Transformers and masked language modeling are quickly being adopted and explored in
computer vision as vision transformers and masked image modeling (MIM). In this work, we …

Hybrid contrastive learning of tri-modal representation for multimodal sentiment analysis

S Mai, Y Zeng, S Zheng, H Hu - IEEE Transactions on Affective …, 2022 - ieeexplore.ieee.org
The wide application of smart devices enables the availability of multimodal data, which can
be utilized in many tasks. In the field of multimodal sentiment analysis, most previous works …

Cross-image pixel contrasting for semantic segmentation

T Zhou, W Wang - IEEE Transactions on Pattern Analysis and …, 2024 - ieeexplore.ieee.org
This work studies the problem of image semantic segmentation. Current approaches focus
mainly on mining “local” context, ie, dependencies between pixels within individual images …

Understanding contrastive learning via distributionally robust optimization

J Wu, J Chen, J Wu, W Shi… - Advances in Neural …, 2023 - proceedings.neurips.cc
This study reveals the inherent tolerance of contrastive learning (CL) towards sampling bias,
wherein negative samples may encompass similar semantics (\eg labels). However, existing …

Contextrast: Contextual contrastive learning for semantic segmentation

C Sung, W Kim, J An, W Lee, H Lim… - Proceedings of the …, 2024 - openaccess.thecvf.com
Despite great improvements in semantic segmentation challenges persist because of the
lack of local/global contexts and the relationship between them. In this paper we propose …

When does contrastive visual representation learning work?

E Cole, X Yang, K Wilber… - Proceedings of the …, 2022 - openaccess.thecvf.com
Recent self-supervised representation learning techniques have largely closed the gap
between supervised and unsupervised learning on ImageNet classification. While the …

Timesurl: Self-supervised contrastive learning for universal time series representation learning

J Liu, S Chen - Proceedings of the AAAI conference on artificial …, 2024 - ojs.aaai.org
Learning universal time series representations applicable to various types of downstream
tasks is challenging but valuable in real applications. Recently, researchers have attempted …