Self-supervised remote sensing feature learning: Learning paradigms, challenges, and future works

C Tao, J Qi, M Guo, Q Zhu, H Li - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Deep learning has achieved great success in learning features from massive remote
sensing images (RSIs). To better understand the connection between three feature learning …

Contrast with reconstruct: Contrastive 3d representation learning guided by generative pretraining

Z Qi, R Dong, G Fan, Z Ge, X Zhang… - … on Machine Learning, 2023 - proceedings.mlr.press
Mainstream 3D representation learning approaches are built upon contrastive or generative
modeling pretext tasks, where great improvements in performance on various downstream …

DiffCSE: Difference-based contrastive learning for sentence embeddings

YS Chuang, R Dangovski, H Luo, Y Zhang… - arxiv preprint arxiv …, 2022 - arxiv.org
We propose DiffCSE, an unsupervised contrastive learning framework for learning sentence
embeddings. DiffCSE learns sentence embeddings that are sensitive to the difference …

Let invariant rationale discovery inspire graph contrastive learning

S Li, X Wang, A Zhang, Y Wu, X He… - … on machine learning, 2022 - proceedings.mlr.press
Leading graph contrastive learning (GCL) methods perform graph augmentations in two
fashions:(1) randomly corrupting the anchor graph, which could cause the loss of semantic …

Learning equivariant segmentation with instance-unique querying

W Wang, J Liang, D Liu - Advances in Neural Information …, 2022 - proceedings.neurips.cc
Prevalent state-of-the-art instance segmentation methods fall into a query-based scheme, in
which instance masks are derived by querying the image feature using a set of instance …

Equivariant similarity for vision-language foundation models

T Wang, K Lin, L Li, CC Lin, Z Yang… - Proceedings of the …, 2023 - openaccess.thecvf.com
This study explores the concept of equivariance in vision-language foundation models
(VLMs), focusing specifically on the multimodal similarity function that is not only the major …

Mine your own anatomy: Revisiting medical image segmentation with extremely limited labels

C You, W Dai, F Liu, Y Min, NC Dvornek… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Recent studies on contrastive learning have achieved remarkable performance solely by
leveraging few labels in medical image segmentation. Existing methods mainly focus on …

Understanding masked image modeling via learning occlusion invariant feature

X Kong, X Zhang - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Abstract Recently, Masked Image Modeling (MIM) achieves great success in self-supervised
visual recognition. However, as a reconstruction-based framework, it is still an open …

Max pooling with vision transformers reconciles class and shape in weakly supervised semantic segmentation

S Rossetti, D Zappia, M Sanzari, M Schaerf… - European conference on …, 2022 - Springer
Abstract Weakly Supervised Semantic Segmentation (WSSS) research has explored many
directions to improve the typical pipeline CNN plus class activation maps (CAM) plus …

Firerisk: A remote sensing dataset for fire risk assessment with benchmarks using supervised and self-supervised learning

S Shen, S Seneviratne, X Wanyan… - … Conference on Digital …, 2023 - ieeexplore.ieee.org
In recent decades, wildfires have caused tremendous property losses, fatalities, and
extensive damage to forest ecosystems. Inspired by the abundance of publicly available …