The evolution of distributed systems for graph neural networks and their origin in graph processing and deep learning: A survey

J Vatter, R Mayer, HA Jacobsen - ACM Computing Surveys, 2023 - dl.acm.org
Graph neural networks (GNNs) are an emerging research field. This specialized deep
neural network architecture is capable of processing graph structured data and bridges the …

Sgformer: Simplifying and empowering transformers for large-graph representations

Q Wu, W Zhao, C Yang, H Zhang… - Advances in …, 2023 - proceedings.neurips.cc
Learning representations on large-sized graphs is a long-standing challenge due to the inter-
dependence nature involved in massive data points. Transformers, as an emerging class of …

A comprehensive survey on deep graph representation learning methods

IA Chikwendu, X Zhang, IO Agyemang… - Journal of Artificial …, 2023 - jair.org
There has been a lot of activity in graph representation learning in recent years. Graph
representation learning aims to produce graph representation vectors to represent the …

Trustworthy graph neural networks: Aspects, methods and trends

H Zhang, B Wu, X Yuan, S Pan, H Tong… - arxiv preprint arxiv …, 2022 - arxiv.org
Graph neural networks (GNNs) have emerged as a series of competent graph learning
methods for diverse real-world scenarios, ranging from daily applications like …

Ordered subgraph aggregation networks

C Qian, G Rattan, F Geerts… - Advances in Neural …, 2022 - proceedings.neurips.cc
Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently,
provably boosting the expressive power of standard (message-passing) GNNs. However …

A comprehensive study on large-scale graph training: Benchmarking and rethinking

K Duan, Z Liu, P Wang, W Zheng… - Advances in …, 2022 - proceedings.neurips.cc
Large-scale graph training is a notoriously challenging problem for graph neural networks
(GNNs). Due to the nature of evolving graph structures into the training process, vanilla …

Sancus: staleness-aware communication-avoiding full-graph decentralized training in large-scale graph neural networks

J Peng, Z Chen, Y Shao, Y Shen, L Chen… - Proceedings of the VLDB …, 2022 - dl.acm.org
Graph neural networks (GNNs) have emerged due to their success at modeling graph data.
Yet, it is challenging for GNNs to efficiently scale to large graphs. Thus, distributed GNNs …

Bns-gcn: Efficient full-graph training of graph convolutional networks with partition-parallelism and random boundary node sampling

C Wan, Y Li, A Li, NS Kim, Y Lin - Proceedings of Machine …, 2022 - proceedings.mlsys.org
Abstract Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art
method for graph-based learning tasks. However, training GCNs at scale is still challenging …

Linkless link prediction via relational distillation

Z Guo, W Shiao, S Zhang, Y Liu… - International …, 2023 - proceedings.mlr.press
Abstract Graph Neural Networks (GNNs) have shown exceptional performance in the task of
link prediction. Despite their effectiveness, the high latency brought by non-trivial …

Magnet: A neural network for directed graphs

X Zhang, Y He, N Brugnone… - Advances in neural …, 2021 - proceedings.neurips.cc
The prevalence of graph-based data has spurred the rapid development of graph neural
networks (GNNs) and related machine learning algorithms. Yet, despite the many datasets …