Revisiting modularity maximization for graph clustering: A contrastive learning perspective

Y Liu, J Li, Y Chen, R Wu, E Wang, J Zhou… - Proceedings of the 30th …, 2024 - dl.acm.org
Graph clustering, a fundamental and challenging task in graph mining, aims to classify
nodes in a graph into several disjoint clusters. In recent years, graph contrastive learning …

Contrastive tuning: A little help to make masked autoencoders forget

J Lehner, B Alkin, A Fürst, E Rumetshofer… - Proceedings of the …, 2024 - ojs.aaai.org
Masked Image Modeling (MIM) methods, like Masked Autoencoders (MAE), efficiently learn
a rich representation of the input. However, for adapting to downstream tasks, they require a …

Memorization in self-supervised learning improves downstream generalization

W Wang, MA Kaleem, A Dziedzic, M Backes… - arxiv preprint arxiv …, 2024 - arxiv.org
Self-supervised learning (SSL) has recently received significant attention due to its ability to
train high-performance encoders purely on unlabeled data-often scraped from the internet …

Cluster-aware semi-supervised learning: relational knowledge distillation provably learns clustering

Y Dong, K Miller, Q Lei, R Ward - Advances in Neural …, 2024 - proceedings.neurips.cc
Despite the empirical success and practical significance of (relational) knowledge distillation
that matches (the relations of) features between teacher and student models, the …

A multi-view graph contrastive learning framework for deciphering spatially resolved transcriptomics data

L Zhang, S Liang, L Wan - Briefings in Bioinformatics, 2024 - academic.oup.com
Spatially resolved transcriptomics data are being used in a revolutionary way to decipher the
spatial pattern of gene expression and the spatial architecture of cell types. Much work has …

Cross-Domain Contrastive Learning for Time Series Clustering

F Peng, J Luo, X Lu, S Wang, F Li - … of the AAAI Conference on Artificial …, 2024 - ojs.aaai.org
Most deep learning-based time series clustering models concentrate on data representation
in a separate process from clustering. This leads to that clustering loss cannot guide feature …

Exploiting Representation Curvature for Boundary Detection in Time Series

Y Shin, J Park, S Yoon, H Song, BS Lee… - The Thirty-eighth Annual …, 2024 - openreview.net
* Boundaries* are the timestamps at which a class in a time series changes. Recently,
representation-based boundary detection has gained popularity, but its emphasis on …

Tight PAC-Bayesian Risk Certificates for Contrastive Learning

A Van Elst, D Ghoshdastidar - arxiv preprint arxiv:2412.03486, 2024 - arxiv.org
Contrastive representation learning is a modern paradigm for learning representations of
unlabeled data via augmentations--precisely, contrastive models learn to embed …

Towards Understanding the Mechanism of Contrastive Learning via Similarity Structure: A Theoretical Analysis

H Waida, Y Wada, L Andéol, T Nakagawa… - … Conference on Machine …, 2023 - Springer
Contrastive learning is an efficient approach to self-supervised representation learning.
Although recent studies have made progress in the theoretical understanding of contrastive …

Contrastive Approach to Prior Free Positive Unlabeled Learning

A Acharya, S Sanghavi - arxiv preprint arxiv:2402.06038, 2024 - arxiv.org
Positive Unlabeled (PU) learning refers to the task of learning a binary classifier given a few
labeled positive samples, and a set of unlabeled samples (which could be positive or …