Self-supervised learning from images with a joint-embedding predictive architecture

M Assran, Q Duval, I Misra… - Proceedings of the …, 2023 - openaccess.thecvf.com
This paper demonstrates an approach for learning highly semantic image representations
without relying on hand-crafted data-augmentations. We introduce the Image-based Joint …

Emerging properties in self-supervised vision transformers

M Caron, H Touvron, I Misra, H Jégou… - Proceedings of the …, 2021 - openaccess.thecvf.com
In this paper, we question if self-supervised learning provides new properties to Vision
Transformer (ViT) that stand out compared to convolutional networks (convnets). Beyond the …

Semi-supervised learning of visual features by non-parametrically predicting view assignments with support samples

M Assran, M Caron, I Misra… - Proceedings of the …, 2021 - openaccess.thecvf.com
This paper proposes a novel method of learning by predicting view assignments with
support samples (PAWS). The method trains a model to minimize a consistency loss, which …

Semi-supervised learning made simple with self-supervised clustering

E Fini, P Astolfi, K Alahari… - Proceedings of the …, 2023 - openaccess.thecvf.com
Self-supervised learning models have been shown to learn rich visual representations
without requiring human annotations. However, in many real-world scenarios, labels are …

The hidden uniform cluster prior in self-supervised learning

M Assran, R Balestriero, Q Duval, F Bordes… - ar** contrastive learning
J Cui, W Huang, Y Wang… - … Conference on Machine …, 2023 - proceedings.mlr.press
Contrastive learning has shown outstanding performances in both supervised and
unsupervised learning, and has recently been introduced to solve weakly supervised …