Sustainable ai: Environmental implications, challenges and opportunities
This paper explores the environmental impact of the super-linear growth trends for AI from a
holistic perspective, spanning Data, Algorithms, and System Hardware. We characterize the …
holistic perspective, spanning Data, Algorithms, and System Hardware. We characterize the …
Self-supervised learning from images with a joint-embedding predictive architecture
This paper demonstrates an approach for learning highly semantic image representations
without relying on hand-crafted data-augmentations. We introduce the Image-based Joint …
without relying on hand-crafted data-augmentations. We introduce the Image-based Joint …
Masked siamese networks for label-efficient learning
Abstract We propose Masked Siamese Networks (MSN), a self-supervised learning
framework for learning image representations. Our approach matches the representation of …
framework for learning image representations. Our approach matches the representation of …
Simmatch: Semi-supervised learning with similarity matching
Learning with few labeled data has been a longstanding problem in the computer vision and
machine learning research community. In this paper, we introduced a new semi-supervised …
machine learning research community. In this paper, we introduced a new semi-supervised …
No representation rules them all in category discovery
In this paper we tackle the problem of Generalized Category Discovery (GCD). Specifically,
given a dataset with labelled and unlabelled images, the task is to cluster all images in the …
given a dataset with labelled and unlabelled images, the task is to cluster all images in the …
Are large-scale datasets necessary for self-supervised pre-training?
Pre-training models on large scale datasets, like ImageNet, is a standard practice in
computer vision. This paradigm is especially effective for tasks with small training sets, for …
computer vision. This paradigm is especially effective for tasks with small training sets, for …
Debiased learning from naturally imbalanced pseudo-labels
This work studies the bias issue of pseudo-labeling, a natural phenomenon that widely
occurs but often overlooked by prior research. Pseudo-labels are generated when a …
occurs but often overlooked by prior research. Pseudo-labels are generated when a …
How to exploit hyperspherical embeddings for out-of-distribution detection?
Out-of-distribution (OOD) detection is a critical task for reliable machine learning. Recent
advances in representation learning give rise to distance-based OOD detection, where …
advances in representation learning give rise to distance-based OOD detection, where …
Debiased self-training for semi-supervised learning
Deep neural networks achieve remarkable performances on a wide range of tasks with the
aid of large-scale labeled datasets. Yet these datasets are time-consuming and labor …
aid of large-scale labeled datasets. Yet these datasets are time-consuming and labor …
Semi-supervised vision transformers at scale
We study semi-supervised learning (SSL) for vision transformers (ViT), an under-explored
topic despite the wide adoption of the ViT architectures to different tasks. To tackle this …
topic despite the wide adoption of the ViT architectures to different tasks. To tackle this …