Computing graph neural networks: A survey from algorithms to accelerators

S Abadal, A Jain, R Guirado, J López-Alonso… - ACM Computing …, 2021 - dl.acm.org
Graph Neural Networks (GNNs) have exploded onto the machine learning scene in recent
years owing to their capability to model and learn from graph-structured data. Such an ability …

A unified lottery ticket hypothesis for graph neural networks

T Chen, Y Sui, X Chen, A Zhang… - … conference on machine …, 2021 - proceedings.mlr.press
With graphs rapidly growing in size and deeper graph neural networks (GNNs) emerging,
the training and inference of GNNs become increasingly expensive. Existing network weight …

Opportunities and challenges of graph neural networks in electrical engineering

E Chien, M Li, A Aportela, K Ding, S Jia… - Nature Reviews …, 2024 - nature.com
Graph neural networks (GNNs) are a class of deep learning algorithms that learn from
graphs, networks and relational data. They have found applications throughout the sciences …

Sancus: staleness-aware communication-avoiding full-graph decentralized training in large-scale graph neural networks

J Peng, Z Chen, Y Shao, Y Shen, L Chen… - Proceedings of the VLDB …, 2022 - dl.acm.org
Graph neural networks (GNNs) have emerged due to their success at modeling graph data.
Yet, it is challenging for GNNs to efficiently scale to large graphs. Thus, distributed GNNs …

Parallel and distributed graph neural networks: An in-depth concurrency analysis

M Besta, T Hoefler - IEEE Transactions on Pattern Analysis and …, 2024 - ieeexplore.ieee.org
Graph neural networks (GNNs) are among the most powerful tools in deep learning. They
routinely solve complex problems on unstructured networks, such as node classification …

PIM-trie: A Skew-resistant Trie for Processing-in-Memory

H Kang, Y Zhao, GE Blelloch, L Dhulipala… - Proceedings of the 35th …, 2023 - dl.acm.org
Memory latency and bandwidth are significant bottlenecks in designing in-memory indexes.
Processing-in-memory (PIM), an emerging hardware design approach, alleviates this …

Gnnear: Accelerating full-batch training of graph neural networks with near-memory processing

Z Zhou, C Li, X Wei, X Wang, G Sun - Proceedings of the International …, 2022 - dl.acm.org
Recently, Graph Neural Networks (GNNs) have become state-of-the-art algorithms for
analyzing non-euclidean graph data. However, to realize efficient GNN training is …

Imga: Efficient in-memory graph convolution network aggregation with data flow optimizations

Y Wei, X Wang, S Zhang, J Yang, X Jia… - … on Computer-Aided …, 2023 - ieeexplore.ieee.org
Aggregating features from neighbor vertices is a fundamental operation in graph convolution
network (GCN). However, the sparsity in graph data creates poor spatial and temporal …

COIN: Communication-aware in-memory acceleration for graph convolutional networks

SK Mandal, G Krishnan, AA Goksoy… - IEEE Journal on …, 2022 - ieeexplore.ieee.org
Graph convolutional networks (GCNs) have shown remarkable learning capabilities when
processing graph-structured data found inherently in many application areas. GCNs …

Accelerating large-scale graph neural network training on crossbar diet

C Ogbogu, AI Arka, BK Joardar… - … on Computer-Aided …, 2022 - ieeexplore.ieee.org
Resistive random-access memory (ReRAM)-based manycore architectures enable
acceleration of graph neural network (GNN) inference and training. GNNs exhibit …