Distributed graph neural network training: A survey

Y Shao, H Li, X Gu, H Yin, Y Li, X Miao… - ACM Computing …, 2024 - dl.acm.org
Graph neural networks (GNNs) are a type of deep learning models that are trained on
graphs and have been successfully applied in various domains. Despite the effectiveness of …

A survey on graph neural network acceleration: Algorithms, systems, and customized hardware

S Zhang, A Sohrabizadeh, C Wan, Z Huang… - arxiv preprint arxiv …, 2023 - arxiv.org
Graph neural networks (GNNs) are emerging for machine learning research on graph-
structured data. GNNs achieve state-of-the-art performance on many tasks, but they face …

Dgi: An easy and efficient framework for gnn model evaluation

P Yin, X Yan, J Zhou, Q Fu, Z Cai, J Cheng… - Proceedings of the 29th …, 2023 - dl.acm.org
While many systems have been developed to train graph neural networks (GNNs), efficient
model evaluation, which computes node embedding according to a given model, remains to …

Comprehensive Evaluation of GNN Training Systems: A Data Management Perspective

H Yuan, Y Liu, Y Zhang, X Ai, Q Wang, C Chen… - arxiv preprint arxiv …, 2023 - arxiv.org
Many Graph Neural Network (GNN) training systems have emerged recently to support
efficient GNN training. Since GNNs embody complex data dependencies between training …

Distributed Matrix-Based Sampling for Graph Neural Network Training

A Tripathy, K Yelick, A Buluc - Proceedings of Machine …, 2024 - proceedings.mlsys.org
Abstract Graph Neural Networks (GNNs) offer a compact and computationally efficient way
to learn embeddings and classifications on graph data. GNN models are frequently large …

Accelerating sampling and aggregation operations in gnn frameworks with gpu initiated direct storage accesses

JB Park, VS Mailthody, Z Qureshi, W Hwu - arxiv preprint arxiv …, 2023 - arxiv.org
Graph Neural Networks (GNNs) are emerging as a powerful tool for learning from graph-
structured data and performing sophisticated inference tasks in various application domains …

Generative and contrastive paradigms are complementary for graph self-supervised learning

Y Wang, X Yan, C Hu, Q Xu, C Yang… - 2024 IEEE 40th …, 2024 - ieeexplore.ieee.org
For graph self-supervised learning (GSSL), masked autoencoder (MAE) follows the
generative paradigm and learns to reconstruct masked graph edges or node features while …

XGNN: Boosting Multi-GPU GNN Training via Global GNN Memory Store

D Tang, J Wang, R Chen, L Wang, W Yu… - Proceedings of the …, 2024 - dl.acm.org
GPUs are commonly utilized to accelerate GNN training, particularly on a multi-GPU server
with high-speed interconnects (eg, NVLink and NVSwitch). However, the rapidly increasing …

Graph neural network training systems: A performance comparison of full-graph and mini-batch

S Bajaj, H Son, J Liu, H Guan, M Serafini - arxiv preprint arxiv:2406.00552, 2024 - arxiv.org
Graph Neural Networks (GNNs) have gained significant attention in recent years due to their
ability to learn representations of graph structured data. Two common methods for training …

Atom: An efficient query serving system for embedding-based knowledge graph reasoning with operator-level batching

Q Zhou, P Yin, X Yan, C Li, G Jiang… - Proceedings of the ACM on …, 2024 - dl.acm.org
Knowledge graph reasoning (KGR) answers logical queries over a knowledge graph (KG),
and embedding-based KGR (EKGR) becomes popular recently, which embeds both queries …