The evolution of distributed systems for graph neural networks and their origin in graph processing and deep learning: A survey
Graph neural networks (GNNs) are an emerging research field. This specialized deep
neural network architecture is capable of processing graph structured data and bridges the …
neural network architecture is capable of processing graph structured data and bridges the …
Distributed graph neural network training: A survey
Graph neural networks (GNNs) are a type of deep learning models that are trained on
graphs and have been successfully applied in various domains. Despite the effectiveness of …
graphs and have been successfully applied in various domains. Despite the effectiveness of …
A comprehensive study on large-scale graph training: Benchmarking and rethinking
Large-scale graph training is a notoriously challenging problem for graph neural networks
(GNNs). Due to the nature of evolving graph structures into the training process, vanilla …
(GNNs). Due to the nature of evolving graph structures into the training process, vanilla …
Parallel and distributed graph neural networks: An in-depth concurrency analysis
Graph neural networks (GNNs) are among the most powerful tools in deep learning. They
routinely solve complex problems on unstructured networks, such as node classification …
routinely solve complex problems on unstructured networks, such as node classification …
Enabling resource-efficient aiot system with cross-level optimization: A survey
The emerging field of artificial intelligence of things (AIoT, AI+ IoT) is driven by the
widespread use of intelligent infrastructures and the impressive success of deep learning …
widespread use of intelligent infrastructures and the impressive success of deep learning …
Neutronstar: distributed GNN training with hybrid dependency management
GNN's training needs to resolve issues of vertex dependencies, ie, each vertex
representation's update depends on its neighbors. Existing distributed GNN systems adopt …
representation's update depends on its neighbors. Existing distributed GNN systems adopt …
Rsc: accelerate graph neural networks training via randomized sparse computations
Training graph neural networks (GNNs) is extremely time consuming because sparse graph-
based operations are hard to be accelerated by community hardware. Prior art successfully …
based operations are hard to be accelerated by community hardware. Prior art successfully …
Understanding gnn computational graph: A coordinated computation, io, and memory perspective
Abstract Graph Neural Networks (GNNs) have been widely used in various domains, and
GNNs with sophisticated computational graph lead to higher latency and larger memory …
GNNs with sophisticated computational graph lead to higher latency and larger memory …
Communication-efficient graph neural networks with probabilistic neighborhood expansion analysis and caching
Training and inference with graph neural networks (GNNs) on massive graphs in a
distributed environment has been actively studied since the inception of GNNs, owing to the …
distributed environment has been actively studied since the inception of GNNs, owing to the …
Survey on graph neural network acceleration: An algorithmic perspective
Graph neural networks (GNNs) have been a hot spot of recent research and are widely
utilized in diverse applications. However, with the use of huger data and deeper models, an …
utilized in diverse applications. However, with the use of huger data and deeper models, an …