The evolution of distributed systems for graph neural networks and their origin in graph processing and deep learning: A survey
Graph neural networks (GNNs) are an emerging research field. This specialized deep
neural network architecture is capable of processing graph structured data and bridges the …
neural network architecture is capable of processing graph structured data and bridges the …
A comprehensive survey on deep graph representation learning
Graph representation learning aims to effectively encode high-dimensional sparse graph-
structured data into low-dimensional dense vectors, which is a fundamental task that has …
structured data into low-dimensional dense vectors, which is a fundamental task that has …
Do transformers really perform badly for graph representation?
The Transformer architecture has become a dominant choice in many domains, such as
natural language processing and computer vision. Yet, it has not achieved competitive …
natural language processing and computer vision. Yet, it has not achieved competitive …
Adan: Adaptive nesterov momentum algorithm for faster optimizing deep models
In deep learning, different kinds of deep networks typically need different optimizers, which
have to be chosen after multiple trials, making the training process inefficient. To relieve this …
have to be chosen after multiple trials, making the training process inefficient. To relieve this …
Masked label prediction: Unified message passing model for semi-supervised classification
Graph neural network (GNN) and label propagation algorithm (LPA) are both message
passing algorithms, which have achieved superior performance in semi-supervised …
passing algorithms, which have achieved superior performance in semi-supervised …
Training graph neural networks with 1000 layers
Deep graph neural networks (GNNs) have achieved excellent results on various tasks on
increasingly large graph datasets with millions of nodes and edges. However, memory …
increasingly large graph datasets with millions of nodes and edges. However, memory …
[PDF][PDF] Natural language is all a graph needs
The emergence of large-scale pre-trained language models, such as ChatGPT, has
revolutionized various research fields in artificial intelligence. Transformersbased large …
revolutionized various research fields in artificial intelligence. Transformersbased large …
Are we really making much progress? revisiting, benchmarking and refining heterogeneous graph neural networks
Heterogeneous graph neural networks (HGNNs) have been blossoming in recent years, but
the unique data processing and evaluation setups used by each work obstruct a full …
the unique data processing and evaluation setups used by each work obstruct a full …
Nested graph neural networks
Graph neural network (GNN)'s success in graph classification is closely related to the
Weisfeiler-Lehman (1-WL) algorithm. By iteratively aggregating neighboring node features …
Weisfeiler-Lehman (1-WL) algorithm. By iteratively aggregating neighboring node features …
Graph neural networks with heterophily
Abstract Graph Neural Networks (GNNs) have proven to be useful for many different
practical applications. However, many existing GNN models have implicitly assumed …
practical applications. However, many existing GNN models have implicitly assumed …