Survey on self-supervised learning: auxiliary pretext tasks and contrastive learning methods in imaging
S Albelwi - Entropy, 2022 - mdpi.com
Although deep learning algorithms have achieved significant progress in a variety of
domains, they require costly annotations on huge datasets. Self-supervised learning (SSL) …
domains, they require costly annotations on huge datasets. Self-supervised learning (SSL) …
Docformer: End-to-end transformer for document understanding
We present DocFormer-a multi-modal transformer based architecture for the task of Visual
Document Understanding (VDU). VDU is a challenging problem which aims to understand …
Document Understanding (VDU). VDU is a challenging problem which aims to understand …
Docformerv2: Local features for document understanding
We propose DocFormerv2, a multi-modal transformer for Visual Document Understanding
(VDU). The VDU domain entails understanding documents (beyond mere OCR predictions) …
(VDU). The VDU domain entails understanding documents (beyond mere OCR predictions) …
Remix: A general and efficient framework for multiple instance learning based whole slide image classification
Whole slide image (WSI) classification often relies on deep weakly supervised multiple
instance learning (MIL) methods to handle gigapixel resolution images and slide-level …
instance learning (MIL) methods to handle gigapixel resolution images and slide-level …
Beyond supervised vs. unsupervised: Representative benchmarking and analysis of image representation learning
By leveraging contrastive learning, clustering, and other pretext tasks, unsupervised
methods for learning image representations have reached impressive results on standard …
methods for learning image representations have reached impressive results on standard …
Emp-ssl: Towards self-supervised learning in one training epoch
Recently, self-supervised learning (SSL) has achieved tremendous success in learning
image representation. Despite the empirical success, most self-supervised learning methods …
image representation. Despite the empirical success, most self-supervised learning methods …
Self-supervised video representation learning using improved instance-wise contrastive learning and deep clustering
Instance-wise contrastive learning (Instance-CL), which learns to map similar instances
closer and different instances farther apart in the embedding space, has achieved …
closer and different instances farther apart in the embedding space, has achieved …
Evaluating self-supervised learning via risk decomposition
Self-supervised learning (SSL) is typically evaluated using a single metric (linear probing on
ImageNet), which neither provides insight into tradeoffs between models nor highlights how …
ImageNet), which neither provides insight into tradeoffs between models nor highlights how …
Guillotine regularization: Why removing layers is needed to improve generalization in self-supervised learning
One unexpected technique that emerged in recent years consists in training a Deep Network
(DN) with a Self-Supervised Learning (SSL) method, and using this network on downstream …
(DN) with a Self-Supervised Learning (SSL) method, and using this network on downstream …
Deciphering the projection head: Representation evaluation self-supervised learning
Self-supervised learning (SSL) aims to learn intrinsic features without labels. Despite the
diverse architectures of SSL methods, the projection head always plays an important role in …
diverse architectures of SSL methods, the projection head always plays an important role in …