The evolution of distributed systems for graph neural networks and their origin in graph processing and deep learning: A survey
Graph neural networks (GNNs) are an emerging research field. This specialized deep
neural network architecture is capable of processing graph structured data and bridges the …
neural network architecture is capable of processing graph structured data and bridges the …
Distributed graph neural network training: A survey
Graph neural networks (GNNs) are a type of deep learning models that are trained on
graphs and have been successfully applied in various domains. Despite the effectiveness of …
graphs and have been successfully applied in various domains. Despite the effectiveness of …
Does graph distillation see like vision dataset counterpart?
Training on large-scale graphs has achieved remarkable results in graph representation
learning, but its cost and storage have attracted increasing concerns. Existing graph …
learning, but its cost and storage have attracted increasing concerns. Existing graph …
P3: Distributed deep graph learning at scale
Graph Neural Networks (GNNs) have gained significant attention in the recent past, and
become one of the fastest growing subareas in deep learning. While several new GNN …
become one of the fastest growing subareas in deep learning. While several new GNN …
ByteGNN: efficient graph neural network training at large scale
Graph neural networks (GNNs) have shown excellent performance in a wide range of
applications such as recommendation, risk control, and drug discovery. With the increase in …
applications such as recommendation, risk control, and drug discovery. With the increase in …
GNNLab: a factored system for sample-based GNN training over GPUs
We propose GNNLab, a sample-based GNN training system in a single machine multi-GPU
setup. GNNLab adopts a factored design for multiple GPUs, where each GPU is dedicated to …
setup. GNNLab adopts a factored design for multiple GPUs, where each GPU is dedicated to …
Sancus: staleness-aware communication-avoiding full-graph decentralized training in large-scale graph neural networks
Graph neural networks (GNNs) have emerged due to their success at modeling graph data.
Yet, it is challenging for GNNs to efficiently scale to large graphs. Thus, distributed GNNs …
Yet, it is challenging for GNNs to efficiently scale to large graphs. Thus, distributed GNNs …
{BGL}:{GPU-Efficient}{GNN} training by optimizing graph data {I/O} and preprocessing
Graph neural networks (GNNs) have extended the success of deep neural networks (DNNs)
to non-Euclidean graph data, achieving ground-breaking performance on various tasks such …
to non-Euclidean graph data, achieving ground-breaking performance on various tasks such …
Parallel and distributed graph neural networks: An in-depth concurrency analysis
Graph neural networks (GNNs) are among the most powerful tools in deep learning. They
routinely solve complex problems on unstructured networks, such as node classification …
routinely solve complex problems on unstructured networks, such as node classification …
Legion: Automatically Pushing the Envelope of {Multi-GPU} System for {Billion-Scale}{GNN} Training
Graph neural network (GNN) has been widely applied in real-world applications, such as
product recommendation in e-commerce platforms and risk control in financial management …
product recommendation in e-commerce platforms and risk control in financial management …