Self-supervised representation learning: Introduction, advances, and challenges

L Ericsson, H Gouk, CC Loy… - IEEE Signal Processing …, 2022 - ieeexplore.ieee.org
Self-supervised representation learning (SSRL) methods aim to provide powerful, deep
feature learning without the requirement of large annotated data sets, thus alleviating the …

Self-supervised learning of graph neural networks: A unified review

Y **e, Z Xu, J Zhang, Z Wang… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Deep models trained in supervised mode have achieved remarkable success on a variety of
tasks. When labeled samples are limited, self-supervised learning (SSL) is emerging as a …

Graphprompt: Unifying pre-training and downstream tasks for graph neural networks

Z Liu, X Yu, Y Fang, X Zhang - Proceedings of the ACM web conference …, 2023 - dl.acm.org
Graphs can model complex relationships between objects, enabling a myriad of Web
applications such as online page/article classification and social recommendation. While …

Long range graph benchmark

VP Dwivedi, L Rampášek, M Galkin… - Advances in …, 2022 - proceedings.neurips.cc
Abstract Graph Neural Networks (GNNs) that are based on the message passing (MP)
paradigm generally exchange information between 1-hop neighbors to build node …

Graph neural networks: foundation, frontiers and applications

L Wu, P Cui, J Pei, L Zhao, X Guo - … of the 28th ACM SIGKDD conference …, 2022 - dl.acm.org
The field of graph neural networks (GNNs) has seen rapid and incredible strides over the
recent years. Graph neural networks, also known as deep learning on graphs, graph …

Graph self-supervised learning: A survey

Y Liu, M **, S Pan, C Zhou, Y Zheng… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Deep learning on graphs has attracted significant interests recently. However, most of the
works have focused on (semi-) supervised learning, resulting in shortcomings including …

Weisfeiler and lehman go cellular: Cw networks

C Bodnar, F Frasca, N Otter, Y Wang… - Advances in neural …, 2021 - proceedings.neurips.cc
Abstract Graph Neural Networks (GNNs) are limited in their expressive power, struggle with
long-range interactions and lack a principled way to model higher-order structures. These …

On the bottleneck of graph neural networks and its practical implications

U Alon, E Yahav - arxiv preprint arxiv:2006.05205, 2020 - arxiv.org
Since the proposal of the graph neural network (GNN) by Gori et al.(2005) and Scarselli et
al.(2008), one of the major problems in training GNNs was their struggle to propagate …

Self-supervised learning on graphs: Contrastive, generative, or predictive

L Wu, H Lin, C Tan, Z Gao, SZ Li - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Deep learning on graphs has recently achieved remarkable success on a variety of tasks,
while such success relies heavily on the massive and carefully labeled data. However …

A comprehensive survey on deep clustering: Taxonomy, challenges, and future directions

S Zhou, H Xu, Z Zheng, J Chen, Z Li, J Bu, J Wu… - ACM Computing …, 2024 - dl.acm.org
Clustering is a fundamental machine learning task, which aim at assigning instances into
groups so that similar samples belong to the same cluster while dissimilar samples belong …