The evolution of distributed systems for graph neural networks and their origin in graph processing and deep learning: A survey

J Vatter, R Mayer, HA Jacobsen - ACM Computing Surveys, 2023 - dl.acm.org
Graph neural networks (GNNs) are an emerging research field. This specialized deep
neural network architecture is capable of processing graph structured data and bridges the …

Computing graph neural networks: A survey from algorithms to accelerators

S Abadal, A Jain, R Guirado, J López-Alonso… - ACM Computing …, 2021 - dl.acm.org
Graph Neural Networks (GNNs) have exploded onto the machine learning scene in recent
years owing to their capability to model and learn from graph-structured data. Such an ability …

Bond: Benchmarking unsupervised outlier node detection on static attributed graphs

K Liu, Y Dou, Y Zhao, X Ding, X Hu… - Advances in …, 2022 - proceedings.neurips.cc
Detecting which nodes in graphs are outliers is a relatively new machine learning task with
numerous applications. Despite the proliferation of algorithms developed in recent years for …

Gnnautoscale: Scalable and expressive graph neural networks via historical embeddings

M Fey, JE Lenssen, F Weichert… - … on machine learning, 2021 - proceedings.mlr.press
We present GNNAutoScale (GAS), a framework for scaling arbitrary message-passing GNNs
to large graphs. GAS prunes entire sub-trees of the computation graph by utilizing historical …

Dorylus: Affordable, scalable, and accurate {GNN} training with distributed {CPU} servers and serverless threads

J Thorpe, Y Qiao, J Eyolfson, S Teng, G Hu… - … USENIX Symposium on …, 2021 - usenix.org
A graph neural network (GNN) enables deep learning on structured graph data. There are
two major GNN training obstacles: 1) it relies on high-end servers with many GPUs which …

Distributed graph neural network training: A survey

Y Shao, H Li, X Gu, H Yin, Y Li, X Miao… - ACM Computing …, 2024 - dl.acm.org
Graph neural networks (GNNs) are a type of deep learning models that are trained on
graphs and have been successfully applied in various domains. Despite the effectiveness of …

Degree-quant: Quantization-aware training for graph neural networks

SA Tailor, J Fernandez-Marques, ND Lane - arxiv preprint arxiv …, 2020 - arxiv.org
Graph neural networks (GNNs) have demonstrated strong performance on a wide variety of
tasks due to their ability to model non-uniform structured data. Despite their promise, there …

Bns-gcn: Efficient full-graph training of graph convolutional networks with partition-parallelism and random boundary node sampling

C Wan, Y Li, A Li, NS Kim, Y Lin - Proceedings of Machine …, 2022 - proceedings.mlsys.org
Abstract Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art
method for graph-based learning tasks. However, training GCNs at scale is still challenging …

GNNLab: a factored system for sample-based GNN training over GPUs

J Yang, D Tang, X Song, L Wang, Q Yin… - Proceedings of the …, 2022 - dl.acm.org
We propose GNNLab, a sample-based GNN training system in a single machine multi-GPU
setup. GNNLab adopts a factored design for multiple GPUs, where each GPU is dedicated to …

Pagraph: Scaling gnn training on large graphs via computation-aware caching

Z Lin, C Li, Y Miao, Y Liu, Y Xu - … of the 11th ACM Symposium on Cloud …, 2020 - dl.acm.org
Emerging graph neural networks (GNNs) have extended the successes of deep learning
techniques against datasets like images and texts to more complex graph-structured data …